#artificial intelligence

Subscribe
Artificial Intelligence (AI) is a branch of computer science that focuses on creating machines that can think and act like humans. It involves the development of algorithms and software that can understand, interpret, and react to data and situations in ways similar to humans. AI has many applications, such as robotics, autonomous vehicles, natural language processing, computer vision, and more. In the JavaScript domain, AI is used for tasks such as natural language processing, image analysis, and machine learning.
Llms Workshop: What They Are and How to Leverage Them
React Summit 2024React Summit 2024
66 min
Llms Workshop: What They Are and How to Leverage Them
Featured Workshop
Nathan Marrs
Haris Rozajac
2 authors
Join Nathan in this hands-on session where you will first learn at a high level what large language models (LLMs) are and how they work. Then dive into an interactive coding exercise where you will implement LLM functionality into a basic example application. During this exercise you will get a feel for key skills for working with LLMs in your own applications such as prompt engineering and exposure to OpenAI's API.
After this session you will have insights around what LLMs are and how they can practically be used to improve your own applications.
Table of contents: - Interactive demo implementing basic LLM powered features in a demo app- Discuss how to decide where to leverage LLMs in a product- Lessons learned around integrating with OpenAI / overview of OpenAI API- Best practices for prompt engineering- Common challenges specific to React (state management :D / good UX practices)
AI + UX: Product Design for Intelligent Experiences
C3 Dev Festival 2024C3 Dev Festival 2024
28 min
AI + UX: Product Design for Intelligent Experiences
AI design challenges include bias, safety, and security. Trust and transparency are important in AI. Design principles for AI include user control, fighting bias, and promoting good decision-making. AI can enable the design process and investors expect to see it included in products. AI empowers individuals to create and share ideas, but managing expectations is crucial.
Bring the Power of AI to Your Application
C3 Dev Festival 2024C3 Dev Festival 2024
28 min
Bring the Power of AI to Your Application
This Talk covers various aspects of artificial intelligence and user experience in software development. It explores the evolution and capabilities of large language models, the importance of prompt engineering, and the need to design AI applications with human users in mind. The Talk also emphasizes the need to defensively design for AI failure, consider user happiness, and address the responsibility and risks of AI implementation. It concludes with recommendations for further reading and highlights the importance of trustworthiness in AI code tools.
OpenAI in React: Integrating GPT with Your React Application
React Summit 2024React Summit 2024
10 min
OpenAI in React: Integrating GPT with Your React Application
In this Talk, the speaker demonstrates how to create an AI chat bot that can answer questions based on information it was never trained on. They build a basic RAG pipeline in just five minutes using live coding. The speaker also shows how to create embeddings and a vector database, set up a vector search index and endpoint, and modify the chat route to enhance the chat bot's capabilities. The program is run and tested, and the Talk concludes with an invitation to join a workshop for more information.
What AI Can, Can’t, and Shouldn’t Do for Games
C3 Dev Festival 2024C3 Dev Festival 2024
26 min
What AI Can, Can’t, and Shouldn’t Do for Games
AI in game development has evolved rapidly, with generative AI being a focus. However, game developers like Romero Games have concerns about ethics and prefer using AI to automate processes and make creative work easier. AI has been used in games for decades, from path-finding AI to decision trees. Procedural world building and advanced AI technology are pushing the boundaries of FPS games. Different teams within a company have different approaches to the use of AI, depending on their specific needs and requirements.
Web Apps of the Future With Web AI
JSNation 2024JSNation 2024
32 min
Web Apps of the Future With Web AI
Web AI in JavaScript allows for running machine learning models client-side in a web browser, offering advantages such as privacy, offline capabilities, low latency, and cost savings. Various AI models can be used for tasks like background blur, text toxicity detection, 3D data extraction, face mesh recognition, hand tracking, pose detection, and body segmentation. JavaScript libraries like MediaPipe LLM inference API and Visual Blocks facilitate the use of AI models. Web AI is in its early stages but has the potential to revolutionize web experiences and improve accessibility.
Leveraging LLMs to Build Intuitive AI Experiences With JavaScript
JSNation 2024JSNation 2024
108 min
Leveraging LLMs to Build Intuitive AI Experiences With JavaScript
Featured Workshop
Roy Derks
Shivay Lamba
2 authors
Today every developer is using LLMs in different forms and shapes, from ChatGPT to code assistants like GitHub CoPilot. Following this, lots of products have introduced embedded AI capabilities, and in this workshop we will make LLMs understandable for web developers. And we'll get into coding your own AI-driven application. No prior experience in working with LLMs or machine learning is needed. Instead, we'll use web technologies such as JavaScript, React which you already know and love while also learning about some new libraries like OpenAI, Transformers.js
AI on Demand: Serverless AI
DevOps.js Conf 2024DevOps.js Conf 2024
163 min
AI on Demand: Serverless AI
Top Content
Featured WorkshopFree
Nathan Disidore
Nathan Disidore
In this workshop, we discuss the merits of serverless architecture and how it can be applied to the AI space. We'll explore options around building serverless RAG applications for a more lambda-esque approach to AI. Next, we'll get hands on and build a sample CRUD app that allows you to store information and query it using an LLM with Workers AI, Vectorize, D1, and Cloudflare Workers.
Code coverage with AI
TestJS Summit 2023TestJS Summit 2023
8 min
Code coverage with AI
Codium is a generative AI assistant for software development that offers code explanation, test generation, and collaboration features. It can generate tests for a GraphQL API in VS Code, improve code coverage, and even document tests. Codium allows analyzing specific code lines, generating tests based on existing ones, and answering code-related questions. It can also provide suggestions for code improvement, help with code refactoring, and assist with writing commit messages.
The Rise of the AI Engineer
React Summit US 2023React Summit US 2023
30 min
The Rise of the AI Engineer
Watch video: The Rise of the AI Engineer
The rise of AI engineers is driven by the demand for AI and the emergence of ML research and engineering organizations. Start-ups are leveraging AI through APIs, resulting in a time-to-market advantage. The future of AI engineering holds promising results, with a focus on AI UX and the role of AI agents. Equity in AI and the central problems of AI engineering require collective efforts to address. The day-to-day life of an AI engineer involves working on products or infrastructure and dealing with specialties and tools specific to the field.
Building the AI for Athena Crisis
JS GameDev Summit 2023JS GameDev Summit 2023
37 min
Building the AI for Athena Crisis
Join Christoph from Nakazawa Tech in building the AI for Athena Crisis, a game where the AI performs actions just like a player. Learn about the importance of abstractions, primitives, and search algorithms in building an AI for a video game. Explore the architecture of Athena Crisis, which uses immutable persistent data structures and optimistic updates. Discover how to implement AI behaviors and create a class for the AI. Find out how to analyze units, assign weights, and prioritize actions based on the game state. Consider the next steps in building the AI and explore the possibility of building an AI for a real-time strategy game.
Building a Voice-Enabled AI Assistant With Javascript
JSNation 2023JSNation 2023
21 min
Building a Voice-Enabled AI Assistant With Javascript
Top Content
This Talk discusses building a voice-activated AI assistant using web APIs and JavaScript. It covers using the Web Speech API for speech recognition and the speech synthesis API for text to speech. The speaker demonstrates how to communicate with the Open AI API and handle the response. The Talk also explores enabling speech recognition and addressing the user. The speaker concludes by mentioning the possibility of creating a product out of the project and using Tauri for native desktop-like experiences.
AI and Web Development: Hype or Reality
JSNation 2023JSNation 2023
24 min
AI and Web Development: Hype or Reality
Top Content
This talk explores the use of AI in web development, including tools like GitHub Copilot and Fig for CLI commands. AI can generate boilerplate code, provide context-aware solutions, and generate dummy data. It can also assist with CSS selectors and regexes, and be integrated into applications. AI is used to enhance the podcast experience by transcribing episodes and providing JSON data. The talk also discusses formatting AI output, crafting requests, and analyzing embeddings for similarity.
Building a Voice-Activated AI Assistant with JavaScript
Building a Voice-Activated AI Assistant with JavaScript
Article
Voice-activated AI assistant development using native web APIs.Utilizing Web Speech API for speech recognition and synthesis.Integration with OpenAI's GPT-3.5 Turbo model for conversational AI.Exploration of Tauri for creating desktop-like applications.Consideration of browser compatibility and user interaction security.Creating a voice-activated AI assistant reminiscent of Jarvis from Iron Man is an exciting project that can be accomplished using native web APIs. This involves building a system that listens, processes, and responds to user queries using JavaScript and OpenAI's GPT-3.5 Turbo model. The primary focus is on using the Web Speech API for both speech recognition and synthesis, enabling a seamless interaction between the user and the AI.The process begins with setting up speech recognition in the browser. The Web Speech API, introduced in 2013, is a key component for converting spoken words into text. Although this API is built into browsers like Chrome, developers must account for different browser implementations and prefixes. The goal is not to create a commercial product but to explore the capabilities of JavaScript in building a functional assistant.Once speech recognition is in place, the text is sent to OpenAI for processing. The integration with OpenAI's completions API allows the AI to understand and respond to user queries. This involves making API requests where the user's spoken words are sent to OpenAI, and the AI's response is received and processed. The responses are then converted back into speech using the Speech Synthesis API, forming a complete conversational loop.This project also considers the possibility of extending the voice-activated assistant into a desktop application using Tauri. Tauri allows developers to create native desktop-like experiences using web technologies and Rust for the backend. This approach enhances performance and opens up new possibilities for deploying the assistant beyond the browser.Throughout the development process, it is crucial to address browser compatibility and security concerns. Different browsers may have varying levels of support for the necessary APIs, and developers need to ensure a consistent experience across platforms. Additionally, security measures are necessary to prevent unauthorized actions, such as requiring user interaction before the assistant can speak.In summary, building a voice-activated AI assistant with native web APIs is an achievable and rewarding endeavor. It involves leveraging the Web Speech API for speech recognition and synthesis, integrating with OpenAI for conversational intelligence, and exploring platforms like Tauri for enhanced application deployment. By focusing on these key areas, developers can create an interactive assistant that provides meaningful and engaging user experiences.
Navigating Large Language Models: Strategies for Software Developers
Navigating Large Language Models: Strategies for Software Developers
Article
Understanding the importance of prompt engineering in interacting with large language models.Recognizing the challenges of data preparation and fine-tuning in AI model development.Exploring the integration of large language models with software development tools.Identifying strategies to manage the limitations and biases of AI models.Utilizing emerging tools and frameworks to enhance AI application development.Large language models (LLMs) have become a cornerstone in modern software development, offering unprecedented capabilities in natural language processing. However, effectively leveraging these models requires a nuanced understanding of various aspects from data preparation to prompt engineering. This article delves into these topics, providing insights and strategies for software developers.One of the primary challenges when working with LLMs is data preparation. The format and quality of data significantly influence the accuracy and reliability of the AI model's output. It's crucial to ensure that data is properly structured and includes all necessary escape characters to avoid errors during processing. This process often takes more time than the actual fine-tuning of the model, highlighting the importance of meticulous data preparation.Prompt engineering is another critical aspect when interacting with LLMs. Crafting well-structured prompts helps the model understand the context and intent, leading to more accurate and relevant outputs. It's essential to provide detailed context and constraints within the prompts, asking for structured output formats like JSON to improve the model's performance.Software developers can enhance their use of LLMs by understanding the importance of hyperparameters, such as temperature and top P, which influence the model's outputs. Adjusting these parameters can help manage the randomness and diversity of responses, making them more deterministic or creative as needed.Incorporating LLMs into software development involves using standard APIs and SDKs. For JavaScript or React developers, integrating LLMs can be relatively straightforward, especially when using tools like Next.js or other vanilla frameworks. This approach keeps the integration simple and minimizes dependencies on additional libraries.Despite the advantages of LLMs, there are significant challenges, including the cost of compute resources and the model's limitations in handling private data. These challenges necessitate careful consideration of the model's context window and managing user inputs to ensure coherent and relevant responses.To address some of these challenges, developers can explore emerging tools and frameworks, such as LangChain, which offer utilities for common LLM use cases. These tools help simplify API calls, manage context, and enhance conversational abilities by maintaining state in applications.Another emerging architecture is the use of agents, which handle tasks by deciding which tools to use based on the input and context. This approach can be particularly useful for dealing with complex and ambiguous problem statements, providing a more dynamic and flexible interaction with the AI model.Developers should also be aware of the potential for AI models to produce hallucinations—outputs that deviate from facts. Implementing prompting best practices and modifying hyperparameters can help mitigate this issue, ensuring that the model's outputs are as accurate and relevant as possible.Finally, the integration of LLMs into development environments is becoming increasingly common, with tools like Copilot and Tab9 offering AI-assisted coding capabilities. These tools can significantly enhance productivity by providing real-time code suggestions and feedback directly within the IDE.Overall, effectively leveraging LLMs in software development requires a combination of prompt engineering, data preparation, and strategic tool use. By understanding these elements, developers can harness the full potential of LLMs, creating more intelligent and responsive applications.
Exploring the Integration of Serverless and AI for Scalable Applications
Exploring the Integration of Serverless and AI for Scalable Applications
Article
Serverless technology offers ease of deployment and scalability.AI models rely on embeddings and vector databases for efficient processing.Retrieval Augmented Generation (RAG) provides contextual enhancement for AI applications.Combining serverless with AI can optimize resource usage and cost.Practical considerations include chunking data and handling cold starts.Serverless technology has transformed the way applications are deployed and scaled. By abstracting the underlying infrastructure, developers can focus on writing code without worrying about server management. Serverless is characterized by infrastructure-less deployments, where applications run on distributed networks, often in microservices or function-as-a-service models. This approach simplifies deployment, making it a one-line operation, and inherently supports scalability.One of the key advantages of serverless is its usage-based billing model. Instead of running servers 24/7, serverless charges based on individual executions, which can be cost-effective for applications with unpredictable traffic patterns. Additionally, serverless deployments often benefit from low latency, as executions occur closer to the end user, reducing connection delays.However, serverless is not without its challenges. Cold starts can introduce latency, particularly in distributed networks where multiple nodes may need to initialize. The stateless nature of serverless functions also requires developers to rethink how applications handle state and shared memory. Despite these challenges, serverless remains a powerful tool for applications that require scalability and minimal server management.AI models, at their core, rely on embeddings and vector databases for efficient processing. An embedding is a numeric representation of data, and vector databases store these embeddings for similarity searches. This is particularly useful in AI applications where pattern recognition and prediction are crucial. Vector databases are optimized for distance computations across the vector space, using metrics like Euclidean or cosine distance to determine the similarity of data points.Retrieval Augmented Generation (RAG) enhances AI applications by providing additional context. When a model's information is insufficient, RAG fetches relevant data from a vector database to augment the AI's output. This approach is beneficial for tasks like prompt-based answering, recommendation engines, and document summarization, where access to up-to-date information is essential.Integrating serverless with AI can optimize resource usage and cost. Traditional AI deployments can be complex, with multiple components running continuously, leading to high costs. In contrast, serverless AI deployments focus on the querying phase, which is where most operations occur. By deploying AI models and vector databases in a serverless manner, developers can achieve a dynamic and cost-effective solution.When building serverless AI applications, practical considerations include chunking data into manageable pieces and handling cold starts. Chunking, or text splitting, involves dividing data into smaller segments to improve the accuracy and relevancy of similarity searches. This process requires balancing the size of chunks to ensure sufficient context without reducing the likelihood of a match.Cold starts, a common issue in serverless environments, occur when a function needs to be initialized before execution. This can be mitigated by keeping frequently accessed models hot across the network, ensuring they are readily available for processing. Despite these challenges, the combination of serverless and AI offers a scalable and efficient solution for modern applications.In conclusion, serverless technology and AI complement each other, providing a robust framework for scalable and cost-effective applications. By leveraging the strengths of both, developers can create powerful systems capable of handling complex tasks with minimal overhead.
Harnessing AI for Enhanced Productivity in Software Development
Harnessing AI for Enhanced Productivity in Software Development
Article
AI enhances productivity and code quality for developers.GitHub Copilot and similar tools streamline coding processes.AI tools assist in generating dummy data and reusable code.Effective AI integration can simplify complex tasks like regex creation.AI can organize and summarize large data sets like podcast transcripts.Artificial Intelligence (AI) is revolutionizing the way developers work, providing significant boosts in productivity and code quality. It is not just a passing trend; AI has become an indispensable tool that developers are integrating into their daily workflow. Unlike past technological buzzwords that fizzled out, AI continuously proves its value in practical applications.One of the most commonly used AI tools among developers is GitHub Copilot. This tool offers real-time assistance by suggesting code snippets as you type, effectively acting as an intelligent coding partner. By understanding the context of your code, it can make suggestions that are tailored specifically to your project, reducing the need to search for solutions online or refer to external resources.Another area where AI shines is in the command-line interface (CLI). Tools like Fig enhance the CLI experience by providing accessible command suggestions, making it easier to navigate and execute complex commands without needing to memorize them. This functionality not only saves time but also reduces the cognitive load on developers, allowing them to focus more on problem-solving and less on syntax.AI chat applications have also become integral to the development process. These tools can answer specific coding queries, provide pull request templates, and even assist in generating boilerplate code. By using AI to handle these routine tasks, developers can allocate more time and resources to the creative aspects of coding, such as designing user interfaces or developing new features.One of the standout benefits of AI is its ability to generate dummy data quickly and efficiently. This is particularly useful for developers who need realistic data sets for testing or demonstration purposes. By providing a simple input, AI can generate comprehensive data structures that can be used to simulate real-world scenarios, allowing developers to test their code more thoroughly.Reusable code is another area where AI excels. By analyzing existing code, AI can suggest improvements and refactor code into reusable classes, adhering to best practices. This not only improves the quality of the codebase but also makes it easier to maintain and extend in the future.AI is also adept at generating CSS and writing complex regular expressions (regex). Creating regex can be a daunting task, even for experienced developers. AI can simplify this process by generating regex patterns based on examples and providing explanations for each component, ensuring that developers understand what the regex is doing and how it can be adjusted if necessary.For those practicing test-driven development, AI can be a valuable asset. It can generate code that satisfies predefined tests and provide iterative improvements based on feedback. While AI is not yet perfect and may require some manual intervention, it significantly reduces the time spent on debugging and refining code.AI's ability to convert code between different paradigms, such as from promises to async/await, demonstrates its versatility. It can optimize code execution by identifying which functions can be run concurrently, thereby improving performance without compromising on functionality.Complex tools like FFmpeg, which require precise command-line inputs, can benefit from AI's ability to translate natural language instructions into executable commands. This capability bridges the gap between human and machine understanding, making powerful tools more accessible to developers of all skill levels.AI's integration capabilities extend to managing dependencies. Instead of manually installing each package, AI tools can automate this process, identifying and installing necessary dependencies with minimal input from the developer, saving time and reducing errors.Beyond individual coding tasks, AI can also enhance the management of large data volumes, such as podcast transcripts. By converting spoken word into text and summarizing the content, AI enables developers to extract valuable insights and create structured data outputs. This process involves condensing transcripts into manageable token limits, ensuring that no critical information is lost while providing a comprehensive overview of the content.The integration of AI in software development is continually evolving, offering new possibilities for enhancing productivity and efficiency. By leveraging AI's capabilities, developers can streamline their workflows, focus on innovation, and produce higher-quality code. As AI tools become more sophisticated, they will undoubtedly play an even more significant role in shaping the future of software development.
Harnessing AI for React Developers: A Guide to Opportunities and Learning Paths
Harnessing AI for React Developers: A Guide to Opportunities and Learning Paths
Article
AI enhances coding efficiency and offers learning opportunities for React developers.AI can be used to build applications that personalize experiences and automate tasks.Understanding AI basics, such as machine learning and large language models, provides a foundation for deeper exploration.APIs are essential tools for integrating AI into projects, enabling new software development possibilities.AI complements human creativity and problem-solving abilities, serving as a powerful tool for developers.AI presents a vast array of opportunities for React developers, enhancing both coding efficiency and learning potential. Tools like Copilot allow developers to code faster and explore documentation more effectively. However, delving into AI offers much more than improved coding speed. It opens doors to creating applications that anticipate user needs, personalize experiences, and automate complex tasks. For those aspiring to launch their own SaaS or shift careers, the demand for AI engineers is rapidly increasing, and the skills JavaScript developers already possess provide a strong foundation for building AI capabilities.Embarking on the path to becoming an AI engineer can feel overwhelming, especially with the myriad of disciplines involved, including data science, machine learning, and mathematics. While comprehensive knowledge in these areas is beneficial, it's essential to focus on what's most relevant and feasible within the time constraints most developers face. Generative AI, for example, is one area where developers can make significant strides. With the availability of open-source APIs and foundation models, making a web request to interact with these APIs positions developers on the right track.AI is a broad field encompassing various technologies that enable machines to mimic human cognitive functions. Machine learning, a subset of AI, involves computers learning from data. Large language models like GPT are specialized tools within machine learning that focus on understanding and generating text. Understanding these basics is crucial for developers, as it provides a starting point for deeper exploration into AI engineering.APIs play a vital role in integrating AI into projects. Through APIs, developers can request AI systems to perform specific tasks. Major players in the AI space, such as OpenAI with GPT, Anthropic with Cloud, and Google with Gemini, offer APIs that developers can experiment with to enhance their projects. It's not just about using these APIs but understanding how they can transform software development. By experimenting with AI APIs, developers can unlock new possibilities for their projects and products.It's essential to explore documentation, such as OpenAI's, to understand how AI assistance APIs function, including features like function calling. Function calling allows large language models to connect with external tools, enabling the AI system to choose the appropriate tool based on user queries. For instance, if a user asks how to dress in Madrid today, the model can call a weather-checking tool, while a request to send an email would prompt the model to use an email-sending tool.Streamlining work with AI is further facilitated by tools like the Vercel AI SDK, compatible with frameworks like Next, Nuxt, Svelte, and Solid. This SDK provides a unified API that standardizes interactions with various AI models, reducing boilerplate code. Developers should also understand Retrieval Augmented Generations (RAGs), which augment models with additional data. In applications like customer service chatbots, developers need to feed the model specific company information, allowing it to retrieve relevant data and generate appropriate responses.Building real-world applications with AI involves more than simple prompts to a large language model. Developers need to orchestrate several tasks, such as understanding user preferences, finding destinations, and checking weather conditions, to create comprehensive solutions. Orchestration frameworks like Langchain and LlamaIndex assist in chaining different tasks together and provide methods for chunking, retrieving, embedding, and generating data. These frameworks also facilitate working with different LLM APIs.Tools like Flowwise offer a graphical user interface on top of Langchain, providing an API for developers. For those who prefer local tools, options like Relevance provide APIs without requiring backend work. These APIs allow developers to access data and build front-end applications as React engineers.Natural language processing is emerging as a critical tool in software development. However, it's crucial to remember that AI cannot replicate the core essence of being a developer. Human abilities to deeply understand, innovate, and creatively solve problems remain irreplaceable. AI serves as a supplement to human capabilities, not a replacement. React developers can certainly learn AI skills and continue to push the boundaries of what's possible in software development. By learning to code with AI and utilizing it to build applications, developers can leverage AI to become the best developers they can be.
Let AI Be Your Docs
JSNation 2024JSNation 2024
69 min
Let AI Be Your Docs
Workshop
Jesse Hall
Jesse Hall
Join our dynamic workshop to craft an AI-powered documentation portal. Learn to integrate OpenAI's ChatGPT with Next.js 14, Tailwind CSS, and cutting-edge tech to deliver instant code solutions and summaries. This hands-on session will equip you with the knowledge to revolutionize how users interact with documentation, turning tedious searches into efficient, intelligent discovery.
Key Takeaways:
- Practical experience in creating an AI-driven documentation site.- Understanding the integration of AI into user experiences.- Hands-on skills with the latest web development technologies.- Strategies for deploying and maintaining intelligent documentation resources.
Table of contents:- Introduction to AI in Documentation- Setting Up the Environment- Building the Documentation Structure- Integrating ChatGPT for Interactive Docs
Ethical AI for the Rest of Us
React Summit 2024React Summit 2024
21 min
Ethical AI for the Rest of Us
AI implementation without considering user benefits can lead to harm and bias. Legal cases highlight the need for AI accountability and addressing biases. Trust, transparency, and efficiency are crucial for building AI systems. Consider the impact of AI on user experience and engage with users. Human oversight is necessary to ensure safety and respect.
Empowering Nx with AI
React Summit 2024React Summit 2024
8 min
Empowering Nx with AI
Today's Talk discusses empowering NX with AI and building an AI-powered documentation system. NX is a powerful build system with smart features like project graph analysis and dependency management. The AI features include an assistant for streamlined navigation of documentation, AI error explainer, and resource allocation optimization on NX Cloud. The AI-powered documentation system uses embeddings and vector matching to find relevant Docs, utilizing tools like OpenAI, GPT, Superbase, and Vercel's AI SDK.
AI for React Developers: Opportunities, Learning, and Innovation
React Summit 2024React Summit 2024
9 min
AI for React Developers: Opportunities, Learning, and Innovation
Top Content
AI offers opportunities for React developers to code faster and automate tasks. Generative AI is a crucial area for developers to focus on. Working with AI APIs and RAGS can open up new possibilities for projects. Orchestration frameworks and tools like Lanchain and relevance help chain tasks together and work with different AI models. AI is a supplement to human capabilities and learning to code with AI can help developers push boundaries and become better.
AI in Front-End Dev: Your Creative Partner or Job Snatcher?
JSNation 2024JSNation 2024
8 min
AI in Front-End Dev: Your Creative Partner or Job Snatcher?
AI in front-end development empowers developers to take on more ambitious projects and innovate at a faster pace. Natural language is a new programming language that can be used for coding, learning, and automating complex tasks. However, it is important to remember that AI is a supplement to human capabilities, not a replacement. Developers need to evolve their skills and stay ahead of emerging technologies to work effectively with AI. The demand for AI engineers is high.
Forget Polygons – Gaussian Splats, the New Approach to Photorealistic 3D Graphics
JSNation 2024JSNation 2024
5 min
Forget Polygons – Gaussian Splats, the New Approach to Photorealistic 3D Graphics
Today, I'll be talking about GspotJS and Gaussian Splatting, a revolutionary graphics pipeline that can render high-fidelity scenes at 144 FPS. Gaussian Splatting is a technique that converts data directly into an image using Gaussians. GspotJS is a lightweight JavaScript library for Gaussian Splat rendering, with features like 4D rendering. The library aims to provide a simple and speedy way to view Splats on the web, while more advanced applications can use Mackellog Gaussian Splats 3D. Both Gaussian Splatting and gSplotJS are open-source.
Mindset: You vs Your AI
C3 Dev Festival 2024C3 Dev Festival 2024
26 min
Mindset: You vs Your AI
This Talk explores the role of mindset in software development and the use of AI assistants. It emphasizes the importance of training the AI assistant and the potential impact of outdated beliefs. The conscious mind is discussed as the gatekeeper to thoughts and feelings, influencing our actions and results. Mindful media consumption and prioritizing mental health are also highlighted, along with the need to support team well-being. The Talk concludes with the significance of fitness in supporting mental health.
Powering Cody Coding Assistant Using LLMs
C3 Dev Festival 2024C3 Dev Festival 2024
29 min
Powering Cody Coding Assistant Using LLMs
This Talk explores the world of coding assistants powered by language models (LLMs) and their use cases in software development. It delves into challenges such as understanding big code and developing models for context in LLMs. The importance of ranking and code context is discussed, along with the use of weak supervision signals and fine-tuning models for code completion. The Talk also touches on the evaluation of models and the future trends in code AI, including automation and the role of tasks, programming languages, and code context.
The Power of a Second Brain in a Developer's Workflow
C3 Dev Festival 2024C3 Dev Festival 2024
8 min
The Power of a Second Brain in a Developer's Workflow
The Talk emphasizes the importance of maintaining a second brain, a curated collection of digital notes, to enhance memory retention in software engineering. Building a second brain helps in recalling information, problem-solving, and retention. It is easy to create your own second brain using various tool options like Notion, Obsidian, Reflect, Rome Research, and Tana. Starting with small, self-contained notes and gradually expanding to form a mesh of related information is recommended for effective learning and retention.
Conducting Interviews and Interviewing in the Age of AI Tools
C3 Dev Festival 2024C3 Dev Festival 2024
29 min
Conducting Interviews and Interviewing in the Age of AI Tools
This talk explores the use of AI in the interviewing process for software engineering. It discusses the history of interviewing and the skills needed for future interviews. The speaker questions the relevance of traditional coding challenges and highlights the shift towards evaluating specific programming languages and debugging skills. The talk also emphasizes the importance of understanding the uses and limitations of AI and the value of communication skills in technical interviews.
Can AI Turn Us Into 10x Developers?
JSNation 2024JSNation 2024
7 min
Can AI Turn Us Into 10x Developers?
AI can help developers become 10x more efficient by leveraging powerful GPUs. Codium is an AI developer tool that can accelerate learning, analyze dependencies, and provide personalized coding experiences. It abstracts away complexity and allows developers to focus on building user experiences. Codium aims to transform the software industry and empower developers to become 10x engineers.
Come On Barbie, Let’s Go Party: Using AI for Music Mixing
JSNation 2024JSNation 2024
27 min
Come On Barbie, Let’s Go Party: Using AI for Music Mixing
Today, we explore DJ mixing and how deep learning revolutionizes the art by discussing sound processing, extracting features, and using machine learning. Deep learning allows for efficient extraction of audio features and high-resolution track separation. Neural networks can achieve source separation by converting audio to spectrograms and applying convolutional and recurrent neural networks. This has immediate impact on industries such as karaoke and music transcription.
AI First: Applications of the Future
JSNation 2024JSNation 2024
26 min
AI First: Applications of the Future
This talk explores the ways AI is being used to shape the future of applications. It emphasizes the importance of an AI-first approach and the potential for AI to enhance various industries, such as aviation. The talk also contrasts the limitations of the AI-on-top approach with the continuous learning and user-centric focus of the AI-first approach. It discusses the importance of building trust through safety, transparency, and browser-based processing, and highlights the potential of AI to address user experience issues and improve accessibility.
Coffee Chat With Documentation, Are You Ready?
JSNation 2024JSNation 2024
34 min
Coffee Chat With Documentation, Are You Ready?
Maya Chavin, a senior software engineer at Microsoft, discusses generative AI and the core model for LM. The flow of a document Q&A service and the importance of prompts in enhancing it are explored. The injection and querying phases of document Q&A are explained, emphasizing the need for efficient storage, indexing, and computing relevant prompts. The talk also covers the use of embedding models, optimization strategies, and the challenges of testing and validating AI results. Creative uses of LLMs and the impact of AI on job security are mentioned.
Can LLMs Learn? Let’s Customize an LLM to Chat With Your Own Data
C3 Dev Festival 2024C3 Dev Festival 2024
48 min
Can LLMs Learn? Let’s Customize an LLM to Chat With Your Own Data
WorkshopFree
Andreia Ocanoaia
Andreia Ocanoaia
Feeling the limitations of LLMs? They can be creative, but sometimes lack accuracy or rely on outdated information. In this workshop, we’ll break down the process of building and easily deploying a Retrieval-Augmented Generation system. This approach enables you to leverage the power of LLMs with the added benefit of factual accuracy and up-to-date information.
Building Your Generative AI Application
React Summit 2024React Summit 2024
82 min
Building Your Generative AI Application
WorkshopFree
Dieter Flick
Dieter Flick
Generative AI is exciting tech enthusiasts and businesses with its vast potential. In this session, we will introduce Retrieval Augmented Generation (RAG), a framework that provides context to Large Language Models (LLMs) without retraining them. We will guide you step-by-step in building your own RAG app, culminating in a fully functional chatbot.
Key Concepts: Generative AI, Retrieval Augmented Generation
Technologies: OpenAI, LangChain, AstraDB Vector Store, Streamlit, Langflow
Building AI Applications for the Web
React Day Berlin 2023React Day Berlin 2023
98 min
Building AI Applications for the Web
Workshop
Roy Derks
Roy Derks
Today every developer is using LLMs in different forms and shapes. Lots of products have introduced embedded AI capabilities, and in this workshop you’ll learn how to build your own AI application. No experience in building LLMs or machine learning is needed. Instead, we’ll use web technologies such as JavaScript, React and GraphQL which you already know and love.
OpenAI in React: Integrating GPT-4 with Your React Application
React Day Berlin 2023React Day Berlin 2023
11 min
OpenAI in React: Integrating GPT-4 with Your React Application
Watch video: OpenAI in React: Integrating GPT-4 with Your React Application
AI is a revolutionary change that helps businesses solve real problems and make applications smarter. Vectors enable semantic search, allowing us to find contextually relevant information. We'll build an AI-powered documentation site that answers questions, provides contextually relevant information, and offers links for further exploration. To enable vector search with MongoDB, we use the LingChain method to connect to MongoDB, create vector embeddings for user queries, and find related documents using maximal marginal reference. Join the workshop for a complete start-to-finish guide and integrate MongoDB Vector Search into your next React-based AI application.
Revolutionizing JS Testing with AI: Unmasking the Future of Quality Assurance
TestJS Summit 2023TestJS Summit 2023
20 min
Revolutionizing JS Testing with AI: Unmasking the Future of Quality Assurance
AI testing with generative AI is revolutionizing JS testing by automating test creation and improving software test processes. Key technologies like natural language processing and neural networks, as well as quality data, play a crucial role in AI testing. The benefits of AI testing include speed, efficiency, adaptability, bug detection, and limitless potential. Generating JavaScript tests can be tailored to different tools like Selenium, and there are popular tools available for automating test automation. AI tools like Datadog, RecheckWeb, and Applitools Eyes offer powerful capabilities for anomaly detection, visual regression testing, and code list testing. The horizon for AI in testing continues to expand with evolving capabilities, and understanding AI's role in testing revolution and machine learning is crucial for practical application and continuous learning.
The Future is Today: Leveraging AI in Software Testing
TestJS Summit 2023TestJS Summit 2023
25 min
The Future is Today: Leveraging AI in Software Testing
This Talk discusses integrating machine learning into software testing, exploring its use in different stages of the testing lifecycle. It highlights the importance of training data and hidden patterns in machine learning. The Talk also covers generating relevant code for test automation using machine learning, as well as the observation and outlier detection capabilities of machine learning algorithms. It emphasizes the use of machine learning in maintenance, bug management, and classifying bugs based on severity levels. The Talk concludes with the results of classification and bug management, including the use of clustering.
Building a Digital Sommelier on Top of ChatGPT and the OpenAI API
React Day Berlin 2023React Day Berlin 2023
8 min
Building a Digital Sommelier on Top of ChatGPT and the OpenAI API
Watch video: Building a Digital Sommelier on Top of ChatGPT and the OpenAI API
Today's Talk introduces the concept of building a digital AI-powered sommelier using the Bracel.ai SDK. The speaker emphasizes the role of developers in shaping the impact of AI, particularly generative AI, on our work. The Talk showcases a simple digital sommelier built using the Resell AI SDK and OpenAI API, highlighting the ease of implementation and the potential of open source tools. The speaker encourages users to explore the possibilities of generative AI responsibly and recommends checking out And Why, a design and technology studio from Munich.
Generative Ai In Your App? What Can Possibly Go Wrong?
TestJS Summit 2023TestJS Summit 2023
29 min
Generative Ai In Your App? What Can Possibly Go Wrong?
Today's Talk discusses the application of GenreBI in apps, using Docker to make ChatGPT work on any machine, challenges with JSON responses, testing AI models, handling AI API and response issues, counting tokens and rate limits, discovering limitations and taking a reactive approach, reliability and challenges of AI APIs, and the use of GPT and AI Copilot in software development.
AI in API Testing: How to Test Faster With ChatGPT
TestJS Summit 2023TestJS Summit 2023
26 min
AI in API Testing: How to Test Faster With ChatGPT
This Talk discusses the use of AI in API testing and provides a step-by-step strategy for incorporating artificial intelligence with chat.dpt. It emphasizes the importance of analyzing documentation and creating test cases using tools like Swagger and Cypress. The Talk also addresses the role of human involvement in testing, the balance between manual work and AI assistance, and the need for validation of AI-generated tests. Overall, AI can significantly speed up the testing process, but human analysis and vigilance are still necessary for accurate results.
Transforming Images Using AI Without Leaving Your React App
React Summit US 2023React Summit US 2023
5 min
Transforming Images Using AI Without Leaving Your React App
Watch video: Transforming Images Using AI Without Leaving Your React App
Today's Talk discusses the importance of transforming images with AI in React apps and the benefits of using image CDNs. The speaker emphasizes the significance of images as a crucial component of websites and the time-consuming nature of adopting image best practices. They propose image transformation on the edge as a faster and easier alternative. The Talk also highlights the use of AI in image transformation, including removing backgrounds, cropping images, and upscaling pixelated images in a Contentful Next JS app. The combination of image CDNs and AI parameters ensures that images always look their best without leaving the React app.
Working With OpenAI and Prompt Engineering for React Developers
React Advanced Conference 2023React Advanced Conference 2023
98 min
Working With OpenAI and Prompt Engineering for React Developers
Top Content
Workshop
Richard Moss
Richard Moss
In this workshop we'll take a tour of applied AI from the perspective of front end developers, zooming in on the emerging best practices when it comes to working with LLMs to build great products. This workshop is based on learnings from working with the OpenAI API from its debut last November to build out a working MVP which became PowerModeAI (A customer facing ideation and slide creation tool).
In the workshop they'll be a mix of presentation and hands on exercises to cover topics including:
- GPT fundamentals- Pitfalls of LLMs- Prompt engineering best practices and techniques- Using the playground effectively- Installing and configuring the OpenAI SDK- Approaches to working with the API and prompt management- Implementing the API to build an AI powered customer facing application- Fine tuning and embeddings- Emerging best practice on LLMOps
Taming Language Models through TypeScript
TypeScript Congress 2023TypeScript Congress 2023
26 min
Taming Language Models through TypeScript
TypeChat is an open-source library that uses TypeScript types to guide and validate responses from language models. It allows for the creation of complex responses and provides a way to repair errors in the model. TypeChat programs enable better flow of data and the ability to refer to individual steps. The math example demonstrates the use of a program translator and metaprogramming techniques for type safety. Language models trained on both code and prose perform well in this context.
WHOA, I Wrote This React App With My Voice!
React Summit 2023React Summit 2023
9 min
WHOA, I Wrote This React App With My Voice!
Watch video: WHOA, I Wrote This React App With My Voice!
Today we're going to build a React application with just our voice using GitHub Copilot, an AI peer programmer powered by OpenAI Codecs. It's important to be specific in your comments to get accurate suggestions from Copilot. Prompt engineering tips can be used to create different applications, such as a basic markdown editor and a simple to-do app. The application was tested successfully by adding and deleting to-do items using voice commands.
Scaling Distributed Machine Learning, to the Edge & Back
JSNation 2023JSNation 2023
21 min
Scaling Distributed Machine Learning, to the Edge & Back
This talk explores JavaScript's role in distributed machine learning at scale, discussing the lack of tooling and the accessibility of machine learning deployments. It also covers cloud-based machine learning architecture, machine learning at the edge, and the use of HarperDB for simplified machine learning deployment. The concept of iterative AI and model training is also discussed.
Improving Developer Happiness with AI
React Summit 2023React Summit 2023
29 min
Improving Developer Happiness with AI
Watch video: Improving Developer Happiness with AI
GitHub Copilot is an auto-completion tool that provides suggestions based on context. Research has shown that developers using Copilot feel less frustrated, spend less time searching externally, and experience less mental effort on repetitive tasks. Copilot can generate code for various tasks, including adding modals, testing, and refactoring. It is a useful tool for improving productivity and saving time, especially for junior developers and those working in unfamiliar domains. Security concerns have been addressed with optional data sharing and different versions for individuals and businesses.
Bring AI-Based Search to Your Web App
JSNation 2023JSNation 2023
31 min
Bring AI-Based Search to Your Web App
The Talk discusses the use of machine learning in search engines, specifically focusing on semantic search and vector embeddings. It explores the integration of JavaScript and machine learning models, using Weaviate as an open-source vector database. The Talk demonstrates how to connect to Weaviate, query data, and perform machine learning queries. It also highlights the benefits of Weaviate, such as its superior developer experience and performance. Additionally, the Talk addresses customization options, data privacy concerns, and the varying effectiveness of different machine learning models.
React + WebGPU + AI – What Could Go Wrong? 😳
JSNation 2023JSNation 2023
31 min
React + WebGPU + AI – What Could Go Wrong? 😳
With AI and web GPU, it's an exciting time to be a developer. The speaker's journey involves combining programming and design, leading to the creation of Pure Blue, a powerful programming environment. Adding AI to the mix, the speaker discusses the potential of AI in the creative process and its impact on app development. The talk explores the role of React components and WebGPU in enabling fine-grained editing and running AI models locally. The future of app development is discussed, emphasizing the need to stay ahead of the curve and leverage the power of JavaScript.
Controlling Apps with Your Mind and AI
React Summit Remote Edition 2020React Summit Remote Edition 2020
25 min
Controlling Apps with Your Mind and AI
This Talk explores controlling apps with the mind and the future of UI and UX. It discusses the integration of VR and AR into UI and UX, the understanding of neurons and EEG headsets, connecting to Muse via Bluetooth, measuring brain waves and blink detection, feeding data to machine learning, and mind control with AR. The speaker emphasizes the importance of learning React Native, AR, React, Bluetooth, and drones for those interested in exploring these topics.
Broadening AI Adoption with AutoML
ML conf EU 2020ML conf EU 2020
9 min
Broadening AI Adoption with AutoML
AutomL simplifies the complexity of building machine learning models, allowing engineers to focus on the hard problems and applications. It enables the solving of problems that wouldn't be feasible otherwise. The three-step AutomL approach by MathWorks includes wavelet scattering for feature extraction. AutoML also enables feature selection and model optimization for memory and power-limited embedded systems. MATLAB can translate to low-level code for deployment.
Teaching ML and AI to Coders
ML conf EU 2020ML conf EU 2020
34 min
Teaching ML and AI to Coders
The Talk discusses the current state of AI and the challenges faced in educating developers. Google's mission is to train 10 percent of the world's developers in machine learning and AI. They have developed specializations and training initiatives to make AI easy and accessible. The impact of AI education includes rigorous certification exams and partnerships with universities. The Talk also highlights the growth trends in the tech industry and the importance of AI skills. TensorFlow is recommended for its deployment capabilities, and practice is emphasized for building a career in machine learning.
Intro to AI for JavaScript Developers with Tensorflow.js
JSNation Live 2021JSNation Live 2021
81 min
Intro to AI for JavaScript Developers with Tensorflow.js
Workshop
Chris Achard
Chris Achard
Have you wanted to explore AI, but didn't want to learn Python to do it? Tensorflow.js lets you use AI and deep learning in javascript – no python required!
We'll take a look at the different tasks AI can help solve, and how to use Tensorflow.js to solve them. You don't need to know any AI to get started - we'll start with the basics, but we'll still be able to see some neat demos, because Tensorflow.js has a bunch of functionality and pre-built models that you can use on the server or in the browser.
After this workshop, you should be able to set up and run pre-built Tensorflow.js models, or begin to write and train your own models on your own data.
Build a UI that Learns - Intelligent Prefetching with React and TensorFlow.js
React Summit Remote Edition 2021React Summit Remote Edition 2021
17 min
Build a UI that Learns - Intelligent Prefetching with React and TensorFlow.js
Today's talk explores intelligent prefetching in React, including code splitting, lazy loading, and prefetching to improve performance. The use of neural networks for sequence prediction and training with actual user behavior is discussed. React context is used to link UI handlers with predictions and prefetching, enabling dynamic content import and improved user experience. The combination of AI and UI development is showcased in this personal project.