Cognitive Assessment through Latency Evaluation

Learn Smarter with CALE

AI-powered adaptive tutor that classifies your errors using difficulty-adjusted response time analysis, and uses spaced review to accelerate mastery.

Patent Pending — CALE Adaptive Learning System (Patent #3)

Difficulty-Adjusted Error Classification Asymmetric Scoring Spaced Review Learning Velocity 15 Adaptive Lessons 3 Domains

(visible to anyone). ALWAYS: Server-side environment variable: process.env.OPENAI_API_KEY. Client sends request to YOUR server, which adds the key and forwards to the API.' }, { concept: 'Cost Optimization', explanation: 'AI product viability often comes down to cost per user. Strategies: cache responses, route simple tasks to cheaper models, set token limits, implement user quotas.', example: 'A product that uses GPT-4 for everything costs $16K/month at 1,000 users. Same product with model routing (GPT-3.5 for simple tasks, GPT-4 for complex only) costs $4K/month. 75% cost reduction with minimal quality impact.' } ], quiz: [ { id: 'at_05_q1', question: 'In AI APIs, a "token" is approximately:', options: ['A cryptocurrency', '4 characters of text', 'A security credential', 'A rate limit unit'], correct: 1, difficulty: 1, bloom_level: 'Remember', explanation: 'A token is roughly 4 characters or ~0.75 words. Both input and output tokens are counted for billing.', misconception: 'Students may confuse AI tokens with cryptocurrency tokens or security tokens. In AI APIs, a token is purely a unit of text measurement.', error_classification: { if_careless: 'Token = ~4 characters of text. The billing unit for AI APIs.', if_procedural: 'Not crypto, not a credential, not a rate limit measure. In AI APIs, a token is approximately 4 characters of text — the unit used for billing and context length.', if_misconception: 'AI tokens have nothing to do with cryptocurrency or security. In the context of AI APIs, a "token" is a text processing unit — roughly 4 characters or 3/4 of a word. It is how AI models measure and bill for text processing.', if_conceptual: 'Language models do not process text as individual characters or words. They use "tokens" — subword units typically 3-4 characters long. The model breaks input text into tokens, processes them, and generates output tokens. Billing is based on total tokens (input + output) because that measures the computational work required.' } }, { id: 'at_05_q2', question: 'Rate limits on AI APIs prevent:', options: ['Users from reading documentation', 'Overloading the service with too many requests', 'Using the API at night', 'Accessing certain models'], correct: 1, difficulty: 1, bloom_level: 'Remember', explanation: 'Rate limits cap the number of requests per minute/hour to prevent any single user from overloading the API infrastructure.', misconception: 'Rate limits are about request volume, not content access, time of day, or documentation.', error_classification: { if_careless: 'Rate limits prevent overloading the service. They cap requests per time period.', if_procedural: 'Not about documentation, time of day, or model access. Rate limits specifically prevent too many requests from overwhelming the API infrastructure.', if_misconception: 'Rate limits do NOT restrict WHAT you can access or WHEN. They restrict HOW MANY requests you can make in a given time period (e.g., 10,000 requests per minute). This prevents any single user from consuming too many server resources.', if_conceptual: 'API infrastructure has finite capacity. Rate limits ensure fair distribution of that capacity across all users. Without rate limits, one user making millions of requests could degrade service for everyone. Rate limits protect the service quality by capping per-user request volume.' } }, { id: 'at_05_q3', question: 'The biggest cost driver for AI-powered products is typically:', options: ['Server hosting', 'Output tokens from LLM API calls', 'Database storage', 'Domain registration'], correct: 1, difficulty: 3, bloom_level: 'Analyze', explanation: 'LLM API costs (especially output tokens, which are more expensive than input tokens) typically dominate the cost structure of AI-powered products.', misconception: 'Students may think traditional hosting costs dominate. For AI products, LLM API usage typically dwarfs all other infrastructure costs.', error_classification: { if_careless: 'LLM output tokens = the biggest cost. They are more expensive than input tokens and often the largest line item.', if_procedural: 'Server hosting, database, and domains are relatively cheap ($10-100/month). LLM API calls at scale can be $1,000-50,000/month depending on usage. Token costs dominate.', if_misconception: 'For traditional apps, hosting is the main cost. For AI apps, LLM API calls dwarf hosting costs. Output tokens (the AI\'s responses) cost 2-3x more than input tokens, and they scale linearly with users. This is why cost management is THE critical skill.', if_conceptual: 'AI product cost structure is fundamentally different from traditional software. Traditional: server costs are primary, scaling costs are infrastructure. AI: LLM API calls are primary, scaling costs are per-request token usage. Output tokens are more expensive because they require more computation. At scale, this becomes the dominant cost by far.' } }, { id: 'at_05_q4', question: 'Which is NOT a valid cost management strategy for AI APIs?', options: ['Caching common responses', 'Using smaller models for simple tasks', 'Sending the entire database as context for every request', 'Setting max token limits'], correct: 2, difficulty: 4, bloom_level: 'Evaluate', explanation: 'Sending the entire database as context for every request wastes tokens and money. Caching, model routing, and token limits are all legitimate cost management strategies.', misconception: 'Students may think more context always improves results. Beyond a point, extra context increases cost without improving quality.', error_classification: { if_careless: 'Sending the entire database = wasting tokens and money. All other options are valid cost strategies.', if_procedural: 'Caching saves repeated calls. Smaller models are cheaper. Token limits cap spend. Sending the entire database is the opposite of cost management — it maximizes unnecessary token usage.', if_misconception: 'More context does NOT always mean better results. Sending irrelevant data as context increases input token costs, can confuse the model (noise > signal), and may exceed context window limits. Effective cost management means sending only the RELEVANT context for each request.', if_conceptual: 'AI API cost management is about maximizing value per token. Every unnecessary token is wasted money. Strategies: (1) Cache — do not call the API for previously answered questions. (2) Model routing — use cheap models for simple tasks, expensive models only when needed. (3) Token limits — cap response length. (4) Relevant context only — never send unnecessary data. Sending the entire database violates principle 4.' } }, { id: 'at_05_q5', question: 'An API key should be:', options: ['Shared publicly for ease of access', 'Stored securely and never exposed in client-side code', 'Posted on GitHub for collaboration', 'Included in the HTML source'], correct: 1, difficulty: 5, bloom_level: 'Evaluate', explanation: 'API keys are authentication credentials that should be stored in environment variables on the server, never exposed in client-side code, public repositories, or HTML source.', misconception: 'This is critical security. Students beginning with APIs sometimes hardcode keys in frontend code where anyone can extract them.', error_classification: { if_careless: 'Server-side only. Never in client code, HTML, or public repos.', if_procedural: 'Public sharing, GitHub posting, and HTML inclusion all expose your key. Anyone who sees it can make unlimited API calls billed to your account. Store it in server-side environment variables only.', if_misconception: 'Exposing an API key is a SECURITY INCIDENT. Anyone with your key can make requests billed to your account, potentially costing thousands of dollars. Keys should be in server-side environment variables (process.env.API_KEY), never in any client-accessible code.', if_conceptual: 'API keys are like passwords for your API account. They authenticate requests and link billing to your account. Any exposure (client-side code, GitHub, HTML) means anyone can impersonate your application and incur charges. The architectural pattern: client sends request to YOUR server, your server adds the API key from a secure environment variable, then forwards to the AI API. The key never leaves your server.' } } ] } ] } }, /* ─────────────────────────────────────────────────────────────────── ERROR CLASSIFICATION — CALE 2D System ─────────────────────────────────────────────────────────────────── */ error_classification: { types: { careless: { description: 'Student knows the material but made a quick slip — answered too fast for the difficulty level.', indicators: 'Very fast response time relative to question difficulty.', remediation: 'Brief reminder of the correct answer, minimal disruption. Move on quickly.', adjusted_time_threshold: '<3 seconds (after difficulty adjustment)', score_impact: -2 }, standard: { description: 'Correct answer or a near-miss where the student knew the general area but picked the wrong option.', indicators: 'Moderate response time, incorrect but close to correct answer.', remediation: 'Show the correct answer with explanation. Offer a Socratic follow-up if available.', adjusted_time_threshold: '3-15 seconds', score_impact: -2 }, misconception: { description: 'Student has a fundamentally wrong mental model about the concept. They answered confidently but incorrectly.', indicators: 'Slow response time (deliberation) but still wrong, suggesting they reasoned carefully from a flawed model.', remediation: 'Directly confront the misconception with counter-evidence. Provide the correct mental model with concrete examples.', adjusted_time_threshold: '15-30 seconds', score_impact: -5 }, conceptual: { description: 'Student does not understand the underlying concept at all. They spent a long time and still got it wrong.', indicators: 'Very slow response time, incorrect answer, difficulty was not extremely high.', remediation: 'Re-teach the concept from scratch with analogy and worked example. Consider revisiting the lesson slides.', adjusted_time_threshold: '>30 seconds', score_impact: -8 } }, difficulty_multipliers: { 1: 1.0, 2: 1.3, 3: 1.6, 4: 2.0, 5: 2.5 }, classification_algorithm: 'adjustedTime = responseTimeMs / difficultyMultiplier[difficulty]. If adjustedTime < 3000ms: careless. If 3000-15000ms: standard. If 15000-30000ms: misconception. If > 30000ms: conceptual.' }, /* ─────────────────────────────────────────────────────────────────── SPACED REVIEW SCHEDULING ─────────────────────────────────────────────────────────────────── */ spaced_review: { intervals: [1, 3, 7, 14, 30, 90], unit: 'days', rules: { correct: 'Advance to the next interval. If at the last interval (90 days), the concept is considered mastered.', incorrect: 'Reset to interval 0 (1 day). The concept re-enters the review queue immediately.', skipped: 'No change. The concept stays at its current interval and will be presented again.', streak_bonus: 'After 3 consecutive correct reviews, skip one interval level (e.g., 7 -> 30 instead of 7 -> 14).' }, priority_algorithm: 'Concepts due for review are prioritized by: (1) overdue items first, (2) items with misconception errors, (3) items with conceptual errors, (4) items at early intervals, (5) random among ties.', mastery_definition: 'A concept is mastered when the student answers correctly at the 90-day interval. Mastered concepts exit the review queue but may re-enter if the student fails a related quiz question.' }, /* ─────────────────────────────────────────────────────────────────── SOCRATIC RESPONSES — Pre-built follow-ups for every wrong answer Keyed by question_id + wrong_option_index ─────────────────────────────────────────────────────────────────── */ socratic_responses: { // ===== PERSONAL FINANCE ===== // PF01 - Emergency Fund Basics pf_01_q1: { 0: "One month would barely cover a single paycheck gap. Think about it — if you lost your job today, how long would it take to find a new one? What does the average job search look like?", 2: "Twelve months is extra cautious but not the standard recommendation. What is the typical range that financial experts suggest, and why that specific range?", 3: "Age is less important than expenses. A 25-year-old and a 55-year-old with the same monthly expenses would need the same emergency fund. What time period does the standard recommendation cover?" }, pf_01_q2: { 0: "CDs lock your money for a set term. What happens when you need emergency cash and your CD does not mature for 6 months? What is the penalty?", 1: "Stocks can lose 30% in a week. If your car breaks down the same week the market crashes, where does the money come from? What quality does an emergency fund need most?", 3: "Checking accounts are liquid but pay 0.01% interest. Is there an account type that offers BOTH instant access AND meaningful interest?" }, pf_01_q3: { 0: "Savings accounts actually have LOWER returns than investing. So why would an emergency fund be more important? Think about what happens WITHOUT one — what do you reach for when an emergency hits?", 2: "The government does not require emergency funds. Think about the math: if you must borrow at 24% because you have no savings, how does that compare to investing at 10%?", 3: "Bank bonuses are nice but not the reason. Think deeper: what costly thing does an emergency fund PREVENT you from doing?" }, pf_01_q4: { 0: "If it only cost $400, there would be no interest at all. But credit cards charge interest on the remaining balance each month. What happens when you only pay the minimum?", 1: "Getting closer, but still underestimating. At 24% APR with minimum payments, how long does it take to pay off $400? And how much interest accumulates over that time?", 3: "$1,200+ would be extreme even for credit cards. The compounding is painful, but not quite that severe on a $400 balance. Think about the range between $500 and $1,200." }, pf_01_q5: { 0: "$100 would not cover most emergencies. What is the average car repair cost? What is a typical ER copay? What amount covers MOST single emergencies?", 1: "$500 is better but still thin. There is a widely-cited first milestone amount that covers most common emergencies — it is a round number. What is it?", 3: "$5,000 is a great intermediate goal but not the 'starter' amount. The starter is something achievable in 2-3 months of focused saving. What smaller round number is typically recommended first?" }, // PF02 - Good Debt vs Bad Debt pf_02_q1: { 0: "A vacation produces no future income and the experience cannot be resold. What makes debt 'good'? Think about whether the thing you are buying will MAKE money or LOSE value.", 1: "A new luxury car loses 20% of its value in year one. Is it generating income? Is it appreciating? What is the difference between this and a rental property?", 3: "Payday loans have extreme interest rates (300-400% APR) for basic consumption. What TWO qualities must debt have to be considered 'good'?" }, pf_02_q2: { 0: "A 10% DTI is excellent but unrealistic for most people with a mortgage. What is the threshold that LENDERS consider the dividing line between healthy and risky?", 1: "25% is healthy but not the standard threshold. Lenders have a specific number they use as the maximum for conventional mortgages. It is in the 30s — what is it?", 3: "50% DTI means half your income goes to debt. That is a financial emergency. The healthy threshold is much lower. What percentage do lenders consider the maximum for 'healthy'?" }, pf_02_q3: { 0: "Reporting to credit bureaus is actually a BENEFIT of credit cards. So that cannot be why they are bad debt. What quality of credit cards makes the debt destructive?", 2: "All debt requires monthly payments — that is not unique to credit cards. What is UNIQUE about credit card debt compared to, say, a mortgage?", 3: "Credit limits being low is not why credit cards are bad debt. Think about the INTEREST RATE and what you are BUYING with the card." }, pf_02_q4: { 0: "$2,400 / $6,000 does not equal 24%. Walk through the division step by step. What is 2,400 divided by 6,000?", 1: "Close, but check your math. $2,400 / $6,000 = ? Try dividing both by 600 first to simplify.", 3: "48% would mean $2,400 / $5,000. But the income is $6,000, not $5,000. What is $2,400 / $6,000?" }, pf_02_q5: { 0: "Student loan interest rates are NOT always low — they can be 5-8%. That is a feature, not the reason they are 'good debt.' What does education DO for you that makes the borrowing productive?", 2: "Government guarantees protect the LENDER, not you. That does not make the debt good for you. What does spending on education produce that makes the debt worthwhile?", 3: "Deferment just delays payments — it does not make the debt productive. Think about what education CREATES that offsets the borrowing cost long-term." }, // PF03 - 50/30/20 Rule pf_03_q1: { 0: "20% is savings, not wants. The three buckets are 50-30-20. Which is in the middle?", 2: "40% is not one of the standard allocations. The rule has specific percentages: 50, 30, and 20. Which one applies to wants?", 3: "50% is for needs (rent, utilities, food). Wants is a smaller allocation. What percentage of the three (50, 30, 20) represents discretionary spending?" }, pf_03_q2: { 0: "Is Netflix required for survival? Would you face serious consequences without it? What is the test for distinguishing needs from wants?", 1: "Restaurant meals are enjoyable but not essential. You can cook at home. Which option represents something you CANNOT safely go without?", 3: "New sneakers are nice, but you can wear existing shoes. Which option, if eliminated, could result in medical bankruptcy?" }, pf_03_q3: { 0: "$500 would be 10%, not 20%. What is 20% of $5,000? Try: $5,000 times 0.20.", 1: "$750 is 15%, which is the old savings recommendation. The 50/30/20 rule allocates a full 20%. What is 20% of $5,000?", 3: "$1,500 would be 30% (the wants allocation). Savings is 20%. What is 20% of $5,000?" }, pf_03_q4: { 0: "The MINIMUM payment is a need because you must pay it. But what about extra payments ABOVE the minimum? Those are a choice. What category are voluntary wealth-building choices?", 1: "Extra debt payments are not a want — they are not entertainment or discretionary spending. They increase your net worth. What category is about building future wealth?", 3: "Extra debt payments absolutely count in this system. Paying down debt builds net worth. Building wealth falls under which of the three categories?" }, pf_03_q5: { 0: "Gross income includes taxes you never receive. Can you allocate money the government already took? What income figure represents what actually hits your bank account?", 2: "Pre-tax minus 401k is closer but not standard. The 50/30/20 rule uses a simpler figure. What is the term for income after ALL taxes are deducted?", 3: "Total household income could be gross or net. The 50/30/20 rule uses a specific type — the amount that actually arrives in your account. What is that called?" }, // PF04 - Credit Score Mechanics pf_04_q1: { 0: "Utilization is 30% — the second largest. What factor at 35% is even bigger? Think about the most fundamental credit obligation.", 2: "Length of history is only 15%. There are two factors larger than that. Which one is the single biggest at 35%?", 3: "Credit mix is only 10%. The largest factor represents the most basic question lenders ask: does this person pay their bills? What factor is that?" }, pf_04_q2: { 0: "50% utilization means using half your credit — that is quite high and will drag your score down. Lenders want to see you using much less. What is the recommended maximum?", 2: "10% is IDEAL, but the question asks about the recommended threshold. There is a widely-cited maximum that you should stay below. It is higher than 10% but lower than 50%.", 3: "0% means no reported usage at all. Surprisingly, the credit scoring system wants to see you USING credit responsibly. What utilization range shows responsible usage?" }, pf_04_q3: { 0: "3% would be $300 / $10,000. But the balance is $3,000. What is $3,000 / $10,000?", 1: "10% would be $1,000 / $10,000. Your balance is $3,000. What is $3,000 / $10,000?", 3: "33% would be if the limit were $9,000. With a $10,000 limit, what is $3,000 / $10,000?" }, pf_04_q4: { 0: "Opening a new card triggers a hard inquiry (hurts 10% factor) and lowers average account age (hurts 15% factor). Is there something you can do that has NO negative side effects?", 2: "Checking your score changes absolutely nothing about the score itself. That is observation, not action. What action directly improves the biggest controllable factor?", 3: "Closing old accounts actually HURTS your score in two ways. Can you think of what those two ways are? And what action would HELP instead?" }, pf_04_q5: { 0: "There is generally no fee for closing a credit card. The damage is structural, not financial. Think about what happens to your total available credit and your average account age.", 2: "Banks do not report a closure as a negative event. The damage is indirect — what happens to two other FICO factors when you lose an old account?", 3: "Closing a card does NOT trigger a hard inquiry. Hard inquiries happen when you APPLY for credit. What actually changes when you close an old card?" }, // PF05 - Compound Interest pf_05_q1: { 0: "6 years would require 72/6=12... wait, 72/X=6 means X=12%. The rate here is 6%, not 12%. What is 72 / 6?", 1: "8 years would mean a 9% rate (72/9=8). But our rate is 6%. What is 72 / 6?", 3: "18 years would mean a 4% rate (72/4=18). Our rate is 6%. Apply the formula: 72 / 6 = ?" }, pf_05_q2: { 0: "$30,000 is the SIMPLE interest answer ($10K + 20 x $1K). But compound interest grows exponentially. How does earning interest on interest change the outcome?", 1: "$45,000 underestimates the power of compounding. Using Rule of 72: at 10%, money doubles every ~7 years. How many doublings in 20 years?", 3: "$100,000 would require a higher rate or longer time. At 10%, money doubles every ~7.2 years. In 20 years, that is about 2.8 doublings. What is $10K doubled 2.8 times?" }, pf_05_q3: { 0: "Tax benefits are similar regardless of age in most cases. Think about the MATHEMATICAL effect of compound growth. What does an extra decade of compounding do to the total?", 2: "Young investors do NOT get better interest rates. The advantage is available to anyone of any age. What mathematical principle explains why starting earlier produces dramatically more?", 3: "Investment options do not fundamentally change with age. The same funds are available to a 25-year-old and a 35-year-old. What changes is TIME. How does more time affect compound growth?" }, pf_05_q4: { 0: "Both simple and compound interest can use the exact same rate. The difference is not in the rate — it is in what the interest is CALCULATED ON each period.", 2: "Compound interest applies to savings, bonds, loans — virtually everything, not just stocks. What is the specific mechanism that makes it different from simple interest?", 3: "Banks do not charge more for compound interest. The difference is mechanical, not financial. In simple interest, you earn on the original amount. In compound interest, you earn on... what?" }, pf_05_q5: { 0: "4 years would require an 18% rate (72/18=4). Our rate is 12%. What is 72 / 12?", 2: "7.2 years is what you get at 10% (72/10=7.2). Our rate is 12%, which means FASTER doubling. What is 72 / 12?", 3: "12 years would mean a 6% rate (72/12=6... wait, that is the answer). 72/12 = 6. Are you sure 12 is correct?" }, // ===== TRADING PSYCHOLOGY ===== // TP01 - Loss Aversion tp_01_q1: { 0: "1.5x is close but underestimates the asymmetry. Kahneman and Tversky found a specific ratio — it is a round number. How much more do losses hurt compared to equivalent gains?", 2: "3x overestimates it. While individual experiences vary, the research consensus established by prospect theory is a lower, round number. What is it?", 3: "5x is far too high. While losses certainly hurt, the established research benchmark is much lower. Kahneman and Tversky found it was roughly... how many times?" }, tp_01_q2: { 0: "Buying in bear markets would actually be contrarian behavior (often smart). The disposition effect is about a specific pattern with existing positions. What do traders do with winners vs losers?", 2: "Overtrading is a different bias (overconfidence). The disposition effect specifically describes an asymmetric treatment of gains and losses. What happens to winning positions? What happens to losing ones?", 3: "Ignoring fundamentals could be many biases. The disposition effect is specifically about HOW you treat positions that are UP versus positions that are DOWN. Think about selling behavior." }, tp_01_q3: { 0: "Never checking your portfolio means you are avoiding information, not managing your emotional response. What approach lets you make EXIT decisions when you are CALM instead of when you are emotional?", 2: "Index funds avoid individual stock picking but do not address loss aversion behavior — you can still panic-sell an index fund during a crash. What specific mechanism removes the emotional exit decision?", 3: "Trading more frequently gives you MORE opportunities to feel loss aversion, not fewer. Exposure does not reduce the bias. What approach removes the emotional decision entirely?" }, tp_01_q4: { 0: "Smart long-term investing holds because the THESIS is intact, not because selling hurts. What is this trader's REASON for holding? Is it analysis or emotion?", 1: "Dollar-cost averaging means deliberately buying more at regular intervals regardless of price. This trader is not buying more — they are just frozen, unable to sell. What drives that frozen state?", 3: "Technical analysis is a methodology (charts, patterns). This trader is not using any methodology — they are driven by a psychological need to avoid realizing the loss. What is that called?" }, tp_01_q5: { 0: "Warren Buffett is a legendary investor but he did not develop prospect theory. He is from the VALUE INVESTING school. Who were the two researchers who published the original prospect theory paper in 1979?", 1: "Benjamin Graham is the 'father of value investing,' not behavioral economics. The researchers you are looking for published in psychology and economics in 1979. One won the Nobel Prize in 2002.", 3: "Eugene Fama developed the Efficient Market Hypothesis, which is the OPPOSITE of behavioral economics. Fama believes markets are rational. Who argued that markets are driven by predictable irrational biases?" }, // TP02 - FOMO and Herding tp_02_q1: { 0: "Nobody feels FOMO when prices are crashing. FOMO is triggered when you see others PROFITING. When do prices peak — when everyone is fearful or when everyone is excited?", 2: "FOMO rarely helps you sell at the right time. In fact, FOMO makes people HOLD during rallies because they fear selling too early. When does FOMO make people BUY?", 3: "FOMO does not help with holding through volatility — it actually causes panic. FOMO is about the BUYING side. When everyone is talking about gains, what does FOMO compel you to do?" }, tp_02_q2: { 0: "Smart money accumulating QUIETLY is the stealth phase, not mania. Mania is the LOUDEST phase. What characterizes it?", 2: "Institutional selling often happens DURING mania (selling to FOMO buyers). But the defining characteristic of mania is what the PUBLIC does. What is the public doing during mania?", 3: "Low volume is characteristic of the stealth phase. Mania has the HIGHEST volume. What drives that volume?" }, tp_02_q3: { 0: "Following top traders on social media is still following SOMEONE ELSE. Is that independent analysis or a form of herding?", 2: "24/7 financial news fills your head with OTHER PEOPLE'S opinions. How does that help you develop YOUR OWN thesis?", 3: "Copying institutional trades is still copying. Whether you copy retail or institutional investors, you are not analyzing independently. What do you need BEFORE looking at what others do?" }, tp_02_q4: { 0: "Buying immediately BECAUSE everyone else is — that IS FOMO. Is that based on your analysis or the crowd's behavior? What would Warren Buffett say about this moment?", 1: "Increasing position size during peak hype amplifies your risk at the worst time. If 'everyone' has already bought, who is left to push the price higher?", 3: "Calling your broker to buy more is just a more formal version of FOMO buying. Think about what Buffett said: 'Be ______ when others are greedy.'" }, tp_02_q5: { 0: "Social proof actually REDUCES research — it replaces analysis with crowd-following. 'If everyone is buying, I do not need to research.' Is that sound logic?", 2: "Social proof does not make decisions faster in a beneficial way. It replaces careful analysis with a shortcut: 'the crowd must know something.' Is the crowd usually right at market extremes?", 3: "Social proof does NOT cause people to avoid popular things — it causes them to EMBRACE them. If everyone is doing something, social proof tells you to... what?" }, // TP03 - Overconfidence tp_03_q1: { 0: "Expert overconfidence exists but has a different name. The Dunning-Kruger effect specifically describes the BEGINNING of the learning curve. Who is MOST overconfident?", 2: "This is statistically impossible — all traders cannot be equally skilled. The Dunning-Kruger effect explains WHY people at a specific skill level overestimate. At what level?", 3: "Experience often DOES improve results, but the Dunning-Kruger effect is about a specific phenomenon. Think about the relationship between CONFIDENCE and COMPETENCE for beginners." }, tp_03_q2: { 0: "Outperforming significantly is what overconfident traders BELIEVE they do. But what does the RESEARCH actually show?", 1: "Matching market returns would mean trading adds no value. The research shows it is actually WORSE than that. Active trading introduces costs that eat into returns. By how much?", 3: "Having the same returns as passive investors would mean trading has no cost. But each trade has fees, spreads, and tax implications. The most active traders do worse than passive. How much worse?" }, tp_03_q3: { 0: "More financial news gives you more INFORMATION but does not make you aware of your own blind spots. What tool gives you feedback on YOUR predictions vs YOUR outcomes?", 2: "Following expert analysts is outsourcing your thinking, not calibrating your own judgment. What tool measures YOUR accuracy over time?", 3: "More technical indicators add complexity but do not tell you whether YOUR predictions are accurate. What would track 'I predicted X, and Y happened' over time?" }, tp_03_q4: { 0: "Under-trading is what cautious, humble people do. Overconfidence pushes in the OPPOSITE direction. If you believe you know what will happen, would you trade more or less?", 1: "Excessive diversification is an admission of uncertainty. Overconfident people do NOT admit uncertainty — they believe they know the winners. Would they spread bets widely or concentrate them?", 3: "More careful analysis is a rational response. Overconfidence is irrational. What irrational behavior does believing 'I know what will happen' produce?" }, tp_03_q5: { 0: "Well-calibrated means your confidence MATCHES your accuracy. Does 80% confidence with 55% accuracy match? What is the gap?", 2: "Being a contrarian means deliberately going against the crowd. This has nothing to do with the gap between prediction confidence and actual results. What is 80% minus 55%?", 3: "The data might be fine — the issue is YOUR PERCEPTION of your accuracy. You thought you were right 80% of the time but were only right 55%. What is that gap called?" }, // TP04 - Anchoring and Framing tp_04_q1: { 0: "'Anchor stocks' is not a real investing concept. Anchoring is a COGNITIVE BIAS about what you fixate on when making decisions. What do traders typically fixate on?", 2: "A balanced portfolio is a strategy, not a bias. Anchoring is about what reference point distorts your EVALUATION of a stock. What number do you fixate on?", 3: "Price targets based on analysis are FORWARD-looking and rational. Anchoring is BACKWARD-looking and irrational — fixating on a past reference point. What kind of past number do traders anchor to?" }, tp_04_q2: { 0: "Fundamental analysis evaluates earnings, revenue, and cash flows. Saying 'X% off its high' evaluates distance from a historical price. Which approach uses the past price as a reference point?", 2: "Value investing compares price to intrinsic value (earnings, cash flows). '70% off its high' compares price to a HISTORICAL price that may have been a bubble. What is the difference?", 3: "Technical analysis uses chart patterns and indicators. '70% off its high' is not a chart pattern — it is a comparison to a single historical data point. What bias does this represent?" }, tp_04_q3: { 0: "Mental accounting is the OPPOSITE of tracking equally. It means you treat some dollars differently than others. How might you treat a $1,000 bonus differently from $1,000 in salary?", 2: "Mental accounting does NOT make people budget more carefully. It actually introduces irrational spending patterns. How would you treat 'gambling winnings' differently from 'salary'?", 3: "Mental accounting undermines consistent saving by creating categories of 'spendable' and 'serious' money. All dollars should be treated equally because a dollar is a... what?" }, tp_04_q4: { 0: "Buying near the 52-week low is ALSO anchoring — you are anchoring to the low price. What approach strips ALL historical reference points?", 2: "Focusing on the purchase price IS the anchor. The question asks how to COMBAT anchoring, not embrace it. What would you evaluate if you had never seen the stock before?", 3: "Setting alerts at prior highs reinforces the anchor. The goal is to REMOVE anchors. What evaluation approach ignores all historical prices?" }, tp_04_q5: { 0: "Not literal picture frames. This is a cognitive bias about how information PRESENTATION changes decisions. Same data, different presentation, different... what?", 2: "Not all frames are equal — that is the whole point. The framing effect shows that DIFFERENT frames of the SAME information lead to DIFFERENT decisions. Why is that significant?", 3: "Not technical chart patterns. The framing effect is a PSYCHOLOGICAL bias about how the PRESENTATION of information changes the DECISION, even when the underlying data is identical." }, // TP05 - Emotional Regulation tp_05_q1: { 1: "Supply and demand drives PRICES, not the emotional trading cycle. The emotional cycle is about individual PSYCHOLOGY. What two emotions alternate to create destructive trading behavior?", 2: "Technical indicators are analysis tools, not emotional drivers. The emotional cycle is powered by two fundamental human emotions. What are they?", 3: "Market makers provide liquidity but do not drive your emotions. The cycle is personal: you feel one emotion (buy high), then another emotion (sell low). Which two?" }, tp_05_q2: { 0: "Not a physical device. In personal trading, a 'circuit breaker' is a self-imposed RULE. What does it force you to do after a series of losses?", 2: "A buy signal is an entry indicator. A circuit breaker is the opposite — it forces you to STOP. When does it activate?", 3: "Not an options strategy. Think about what happens when you lose 3 trades in a row and your emotions are high. What rule could PROTECT you from making more bad decisions?" }, tp_05_q3: { 0: "Systems may or may not be cheaper. Cost is not the relevant advantage. Think about what happens to your decision-making under STRESS. What resource depletes?", 2: "Brokers do not require personal trading systems. The advantage is about reliability under pressure. What happens to willpower when you are stressed and losing money?", 3: "Willpower is not a myth — research shows it exists but is LIMITED. What happens to your willpower during a losing streak, and how do systems help?" }, tp_05_q4: { 0: "There IS no 'perfect entry.' If you are waiting for perfection, you will either never trade or fool yourself into thinking you found it. What skill is about NOT trading?", 1: "Chart reading is a technique, not a skill. Professional traders emphasize one meta-skill above all others. Think about poker: what do the best players do MOST of the time?", 3: "Insider information is ILLEGAL (securities fraud). The underrated skill is something legal and psychological. Professional poker players fold 80% of hands. What trading equivalent does that suggest?" }, tp_05_q5: { 0: "Thesis and entry price are ESSENTIAL parts of a pre-trade checklist. Think about which item introduces EXTERNAL BIAS rather than your own analysis.", 1: "Stop-loss and profit target are ESSENTIAL — they define your exit strategy. Which item on the list would introduce CROWD OPINION into your independent analysis?", 2: "Position size is ESSENTIAL — it determines risk per trade. Which item would undermine independent analysis by introducing social media herding?" }, // ===== AI & TECHNOLOGY ===== // AT01 - AI Agents at_01_q1: { 0: "A bigger model is still a chatbot without goals and tools. What four capabilities transform a language model into an agent?", 2: "Agents can be proprietary or open-source. Licensing model has nothing to do with the definition. What architectural elements make something an agent?", 3: "Agents work in ANY domain — customer service, coding, marketing, trading. What four properties define an agent regardless of domain?" }, at_01_q2: { 0: "Input/Output/Storage/Network describes generic computing architecture. Agent components are about CAPABILITIES, not hardware. What can an agent DO?", 2: "CPU/GPU/RAM/Disk are physical hardware components. Agent components describe functional capabilities: how it senses, thinks, acts, and learns. What are those four called?", 3: "Training/Inference/Fine-tuning/Deployment describes the ML lifecycle. Agent components describe what happens during OPERATION: sensing, deciding, acting, remembering. What are these called?" }, at_01_q3: { 0: "Circular logic is a reasoning ERROR. The agent's loop is INTENTIONAL — it is designed to run continuously. What is the purpose of this continuous cycle?", 2: "A neural network is a model architecture. The reasoning loop is an OPERATIONAL pattern — how the agent behaves during runtime. What does it continuously cycle through?", 3: "Debugging is a human development activity. The reasoning loop is the agent's normal OPERATING mode. It perceives, then thinks, then acts, then... what? And then starts over." }, at_01_q4: { 0: "A larger model improves the agent's REASONING ability but does not let it DO things in the world. What gives an agent the ability to interact with external systems?", 2: "Training data improves what the model KNOWS but does not give it the ability to ACT. What bridges the gap between the agent's decisions and real-world actions?", 3: "A faster computer speeds up processing but does not give new CAPABILITIES. What lets an agent place trades, send emails, or query databases?" }, at_01_q5: { 0: "Memory does not change the model's size (number of parameters). Memory operates at RUNTIME, not at the architecture level. What does runtime memory enable?", 2: "Memory does NOT replace training. Training teaches general knowledge. Memory stores... what kind of information gathered during operation?", 3: "Memory may help efficiency but speed is not its primary purpose. The main value is the ability to maintain CONTEXT and learn from... what?" }, // AT02 - Multi-Agent Systems at_02_q1: { 0: "Multi-agent systems actually use MORE total compute (multiple models running). The advantage is not about efficiency — it is about QUALITY. What makes specialized agents better?", 2: "Multi-agent systems are HARDER to build (coordination complexity). What makes them worth the extra effort?", 3: "Multi-agent systems absolutely REQUIRE coordination — that is the biggest challenge. So why use them? What advantage offsets the coordination cost?" }, at_02_q2: { 0: "Not physical transport. Think of it as a SOFTWARE communication highway. What does it route between agents?", 2: "A database stores data persistently. A message bus ROUTES messages in real-time. What is the distinction between storing and routing?", 3: "Message buses scale to any number of agents. The number of agents is not a limitation. What is the bus's actual function?" }, at_02_q3: { 0: "If ALL agents received ALL signals, every agent would be overwhelmed with irrelevant information. Routing is about SELECTIVE delivery. To whom?", 2: "If only the CEO saw signals, specialists would never receive work. Routing distributes signals to the RIGHT specialist. How does it know which one?", 3: "Signals that are stored but never processed are useless. Routing ensures signals reach agents that will ACT on them. Which agents?" }, at_02_q4: { 0: "If the CEO did all the work, there would be no need for specialist agents. The CEO's role mirrors a human CEO: not doing, but... what?", 2: "A CEO that only monitors and never acts cannot delegate or make strategic decisions. The CEO agent does what a human CEO does: thinks strategically and... what?", 3: "AI agents assist human management; they do not replace it entirely. The CEO agent's role is strategic decision-making and... what?" }, at_02_q5: { 0: "Individual agent intelligence is largely solved by modern LLMs. The challenge unique to MULTI-agent systems is about getting agents to work... how?", 2: "Hardware scales with money. Training data is abundant. The challenge specific to multi-agent architecture is making agents work TOGETHER. What does that involve?", 3: "Training data availability is a general AI challenge, not specific to multi-agent systems. What challenge emerges when you have 30 agents that need to work together without conflicting?" }, // AT03 - Prompt Engineering at_03_q1: { 0: "System prompts are typically HIDDEN from end users. They are instructions from the developer to the AI. What do they set for the AI?", 2: "System prompts can be many paragraphs long. There is no length limit. What is their PURPOSE in the conversation?", 3: "System prompts and user prompts serve different functions. User prompts are individual messages. System prompts PERSIST across the entire conversation. What do they define?" }, at_03_q2: { 1: "'Few' does not mean few words — it means few EXAMPLES. What are those examples made of?", 2: "'Shot' means example, not attempt. It is not about running the model a limited number of times. What do you SHOW the model?", 3: "Model size is unrelated. Few-shot works with any model. 'Few-shot' means providing a few... what?" }, at_03_q3: { 0: "CoT actually SLOWS responses because the model generates more tokens (the reasoning steps). What does it improve in exchange for that slower speed?", 2: "CoT has no effect on model size — the model is the same. It changes how the model PROCESSES the prompt. What does step-by-step reasoning improve?", 3: "CoT is a prompting technique, not a training technique. It happens at inference time. What aspect of the model's output does it improve?" }, at_03_q4: { 0: "'Is TSLA good?' gives the AI zero guidance on what to evaluate. What makes a prompt effective? Specificity about WHAT to analyze and HOW.", 2: "'Tell me about Tesla' is slightly better but still directionless. What specific aspects should you ask the AI to analyze?", 3: "'Buy or sell' asks for advice the AI should not give and provides no analytical framework. What would a STRUCTURED analysis prompt look like?" }, at_03_q5: { 0: "More words does not mean better communication. A 500-word vague prompt produces worse results than a 50-word specific prompt. What matters more than word count?", 2: "Technical jargon can actually CONFUSE the model. Plain, specific language works best. What quality of communication matters most?", 3: "10-word prompts are usually too short to communicate complex intent. But length is not the goal. What IS the goal?" }, // AT04 - AI Ethics at_04_q1: { 0: "BPI scoring runs in milliseconds — it does not slow the AI down. What does it actually DO to each action?", 2: "BPI does not replace human judgment — it provides a FRAMEWORK that complements human oversight. What does it score actions against?", 3: "BPI can block profitable actions if they score low on ethics. It does NOT only allow profitable actions. What criteria does it use?" }, at_04_q2: { 0: "Revenue Alignment is only 12% — one of the lower weights. What principle has the HIGHEST weight to ensure human authority?", 2: "Ethical Compliance at 15% is extremely important but not the highest. There is one principle at 18% that ensures the human retains ultimate authority. What is it?", 3: "User Value at 15% ties with Ethics. But neither is the highest. What principle at 18% ensures the founder retains ultimate control?" }, at_04_q3: { 0: "Bias detection has nothing to do with speed. Think about what happens when an AI learns from data that contains historical discrimination. What does it do with those patterns?", 2: "Bias NEVER improves results — it systematically degrades them for underrepresented groups. What happens when a biased model makes decisions at scale?", 3: "While AI bias legislation is growing, it is not universal. The importance is more fundamental: biased AI produces what kind of outcomes?" }, at_04_q4: { 0: "The AI CAN make decisions — ones that score above the threshold. The veto only blocks SPECIFIC actions. Which ones?", 2: "Not only humans can approve actions. The system automates approval for high-scoring actions. What happens to LOW-scoring actions specifically?", 3: "The AI does not shut down. It continues operating — it just cannot execute THAT specific action. What determines which actions are blocked?" }, at_04_q5: { 0: "Open source and transparency are different concepts. Transparency in AI governance is about decisions being... what?", 2: "Showing all training data is 'data disclosure,' not transparency. Transparency in governance means decisions are... what two qualities?", 3: "Longer responses are not more transparent. Transparency means the REASONING behind decisions is visible. What should every AI decision produce?" }, // AT05 - Building with AI APIs at_05_q1: { 0: "In the AI API context, tokens are not cryptocurrency. They are a unit of TEXT measurement. How many characters is one token approximately?", 2: "A security credential in AI APIs is called an 'API key,' not a token. In this context, a token is a unit of... what?", 3: "Rate limits are measured in requests per minute, not tokens. A token is the fundamental unit of TEXT that AI models process. Approximately how many characters?" }, at_05_q2: { 0: "Rate limits have nothing to do with documentation access. They protect the API SERVICE from being overwhelmed. How? By capping what?", 2: "APIs are available 24/7 — rate limits do not restrict time of day. They restrict the NUMBER of requests in a time period. Why?", 3: "Rate limits do not restrict which models you can use (that is about plan tier). They restrict how MANY requests you can make. This prevents what?" }, at_05_q3: { 0: "Server hosting for a basic app might cost $10-50/month. AI API calls at scale can cost $10,000-50,000/month. Which dominates?", 2: "Database storage is cheap ($5-20/month for most apps). What cost item scales directly with every user interaction?", 3: "Domain registration is $10-15/year. What cost item can reach thousands per month as users increase?" }, at_05_q4: { 0: "Caching IS a valid strategy. It saves money by reusing previous responses. Which option would WASTE tokens instead of saving them?", 1: "Using smaller models IS a valid strategy. It reduces cost per request. Which option would INCREASE costs dramatically?", 3: "Setting max token limits IS a valid strategy. It caps the cost of each response. Which option would maximize unnecessary token usage?" }, at_05_q5: { 0: "Public sharing means ANYONE can use your key and charge your account. How much could an attacker spend in one night? Where should the key live?", 2: "Posting an API key on GitHub is one of the most common security mistakes. Automated bots scan GitHub for exposed keys and exploit them within minutes. Where should the key be stored?", 3: "Including the key in HTML means anyone can view page source and extract it. This is called 'client-side exposure.' Where should API keys live instead?" } }, /* ─────────────────────────────────────────────────────────────────── KB SEARCH — Find relevant knowledge for any student query ─────────────────────────────────────────────────────────────────── */ search(query) { const q = query.toLowerCase(); const results = []; for (const [domainKey, domain] of Object.entries(this.domains)) { for (const lesson of domain.lessons) { // Score lesson relevance let score = 0; const titleMatch = lesson.title.toLowerCase().includes(q); const contentMatch = lesson.content.toLowerCase().includes(q); const conceptMatch = lesson.key_concepts.some(c => c.toLowerCase().includes(q)); if (titleMatch) score += 10; if (contentMatch) score += 5; if (conceptMatch) score += 8; // Check teaching points for (const tp of lesson.teaching_points) { if (tp.concept.toLowerCase().includes(q)) score += 7; if (tp.explanation.toLowerCase().includes(q)) score += 3; if (tp.example.toLowerCase().includes(q)) score += 2; } // Check quiz questions for (const quiz of lesson.quiz) { if (quiz.question.toLowerCase().includes(q)) score += 4; if (quiz.explanation.toLowerCase().includes(q)) score += 2; } if (score > 0) { results.push({ domainKey, domain, lesson, score }); } } } // Sort by relevance score, descending results.sort((a, b) => b.score - a.score); return results; }, /* ─────────────────────────────────────────────────────────────────── Get lesson by reference ID (L1-L15) ─────────────────────────────────────────────────────────────────── */ getLessonByRef(ref) { for (const domain of Object.values(this.domains)) { for (const lesson of domain.lessons) { if (lesson.lesson_ref === ref) return { domain, lesson }; } } return null; }, /* ─────────────────────────────────────────────────────────────────── Get Socratic response for a specific wrong answer ─────────────────────────────────────────────────────────────────── */ getSocraticResponse(questionId, wrongOptionIndex) { const responses = this.socratic_responses[questionId]; if (!responses) return null; return responses[wrongOptionIndex] || null; }, /* ─────────────────────────────────────────────────────────────────── Get error classification remediation for a question ─────────────────────────────────────────────────────────────────── */ getErrorRemediation(questionId, errorType) { // Find the quiz question across all domains for (const domain of Object.values(this.domains)) { for (const lesson of domain.lessons) { for (const quiz of lesson.quiz) { if (quiz.id === questionId && quiz.error_classification) { const key = `if_${errorType}`; return quiz.error_classification[key] || null; } } } } return null; }, /* ─────────────────────────────────────────────────────────────────── Get all quiz questions for a lesson by lesson_ref ─────────────────────────────────────────────────────────────────── */ getQuizByLessonRef(ref) { const result = this.getLessonByRef(ref); if (!result) return []; return result.lesson.quiz; }, /* ─────────────────────────────────────────────────────────────────── Build a spaced review queue from student profile ─────────────────────────────────────────────────────────────────── */ buildReviewQueue(studentErrors) { // studentErrors: array of { questionId, errorType, lastReviewDate, interval } const now = new Date(); const queue = []; for (const error of studentErrors) { const lastReview = new Date(error.lastReviewDate); const daysSince = Math.floor((now - lastReview) / (1000 * 60 * 60 * 24)); const currentInterval = this.spaced_review.intervals[error.interval] || 1; if (daysSince >= currentInterval) { let priority = 0; if (daysSince > currentInterval) priority += (daysSince - currentInterval); // overdue bonus if (error.errorType === 'misconception') priority += 10; if (error.errorType === 'conceptual') priority += 8; if (error.interval < 2) priority += 5; // early intervals queue.push({ ...error, priority, daysSince, dueIn: 0 }); } } queue.sort((a, b) => b.priority - a.priority); return queue; } }; // Export for use in CALE Tutor if (typeof module !== 'undefined' && module.exports) { module.exports = TUTOR_KB; }

This product is designed for educational use. For users under 13, parental consent is required. We do not knowingly collect personal information from children under 13. See our Privacy Policy at reaveslabs.ai/privacy.

CALE Tutor Pro

View in Store →

Progress saved

Learn Smarter with CALE

Cognitive Assessment through Latency Evaluation

CALE Profile