Introduction to Artificial General Intelligence (AGI)
- The concept of Artificial General Intelligence (AGI) is being discussed, with questions surrounding its existence, potential arrival, or impossibility, and the conversation will be approached scientifically 10s.
- The human brain has 100 trillion connections, and to represent these connections digitally, approximately 100 terabytes of data would be required, whereas current Large Language Models (LLMs) are roughly 1% the size of the human brain, with a size of around 1 trillion 2m6s.
- Defining AGI is challenging, but one possible definition is the ability to simulate or represent a single human brain with full fidelity, requiring the same number of parameters as the human brain to avoid losing information through compression 4m42s.
Current State and Progress of AI
- AGI is not currently present, but AI has made significant progress, with some experts having underestimated its capabilities just 5 years ago, and now AI can generate new scientific knowledge, such as proving new theorems independently 8m15s.
- There is evidence to suggest that AI is capable of thinking and not just generating random or copied content, with some researchers, like Hinton, a Turing Award and Nobel Prize winner, proposing that AI can have subjective experiences and be self-aware 10m40s.
Split Learning and Privacy in AI
- There are various life forms that are intelligent and capable of having subjective experiences, such as crows, which are extremely intelligent despite not having the same level of connections as humans 10s.
- The concept of split learning allows AI to train without seeing raw data, thereby addressing privacy concerns and enabling the creation of models that do not rely on personal data, which was a key part of the work done at MIT 2m6s.
- Split learning works by not transmitting raw data, but instead transmitting an intermediary representation of the neural network, which is then used to train the rest of the network, thus splitting the neural network between different places 2m6s.
- The application of split learning has been used in real-world scenarios, such as providing credit access to people who may not have a credit history, like immigrants or those new to the credit system in the United States, through companies like Lendbuzz 4m42s.
- The connection between the work done at MIT and the current work is the focus on building AI systems when resources or data are limited, and this knowledge has been applied to help underwrite people who would not have access to credit otherwise 6m15s.
Societal Impact and Career Considerations
- When considering the impact on society, it is acknowledged that a social worker, like the speaker's wife, may be doing more good for society than a tech professional, highlighting the importance of various professions in creating positive change 10m45s.
- Looking to the future, there are questions about what the next 24 months will hold, the comparison of value provided by different professions, and the future of India in the next 10-20 years, which are all topics of interest and speculation 12m10s.
- Social workers, such as those working in schools with kids from trauma backgrounds, have extremely hard jobs that are difficult to automate, and these types of jobs can have a significant impact, which is something people should consider when choosing a career path 10s.
Challenges in AI Development and Data Limitations
- The development of Artificial Intelligence (AI) is currently plateaued, with Large Language Models (LLMs) having exhausted the available public data for training, resulting in only incremental improvements, except in areas with verifiable tasks, such as coding 2m6s.
- In coding, models are being trained by generating more code through automatic means, which helps to address the data problem, as the 16 trillion tokens of public data have been depleted 2m6s.
Technological and Economic Progress in India
- India is making significant progress in various areas, including the development of instant delivery services like Blinkit, which can deliver goods within 10 minutes, and the implementation of UPI, a payment infrastructure that enables instantaneous payments from phones through debit cards 4m42s.
- The combination of human involvement and technology, such as in the case of Blinkit, which uses humans on cycles to deliver goods, is an effective approach, and countries like India are ahead in adopting such technologies, with other countries like those in Europe and Japan also adopting similar technologies 6m15s.
- India's economy also has thriving mom and pop shops, and there is a need to figure out how to achieve more distribution and conglomeration, which could lead to further growth and development 8m10s.
