Joshua 8:1
This is a short film movie trailer that I created using the several Ai services listed below. I hope to eventually be able to create a full length movies and video games using software like this.
Interact with the AI tools available whether it involves creating an image or asking a question but do not use ChatGPT or any other that relates to it such as Bard.
Note down the result for example if you have used ChefGPT write down the full recipe provided based on your prompts.
Used Midjourney to create anime character images to be used as reference for image-to-video
Used Pika.art and Kaiber to create a 1 minute trailer.
Used ChatGPT to generate the script for the trailer.
Used Eleven Labs to generate the voice over.
Used Capcut to edit the videos
Identify any challenges that you faced interacting with the tool.
The main challenge I faced was creating prompts that would generate the images and videos that I wanted.
It took quite a few tries to get the right look. Prompts have to be detailed to get the result you want.
I learned not to erase "bad" images or videos
The images took much longer to generate since most of the time I did not get the results I was looking for.
For the videos I basically used everything that was generated. Since the clips are shorter then it's hard to tell where the defects are in the animation.
When ever I added too many options for example, 'zoom out' only works better than 'zoom out' and 'pan left'. Errors start showing up when you add too many details.
Identify any positive outcomes with the use of the tool.
With Midjourney I can use to create the right art style and character look.
With Pika I can create part of the movie and I can use Kaiber to transform images from MJ into MP4 videos.
Identify the possible branch that the tool you used lies under and why that branch. Provide examples from the use of the tool.
These AI programs integrate multiple AI branches to create a seamless user experience, where each component contributes to the system's overall ability to understand, create, and personalize content. For instance, NLP processes user inputs, ML personalizes the experience based on past interactions, CV analyzes and processes images, and GANs generate new, creative outputs.
After utilizing the tool, analyze it in terms of the AI lifecycle in that identify what challenge or problem the tool is being utilized to solve.
Problem Identification: They address the need for scalable, customizable visual content generation from textual descriptions or image modifications.
Data Preparation: A challenge is collecting and preparing diverse datasets to train models on a wide range of styles and contexts.
Model Training: Selecting and training models (GANs, CNNs) to accurately translate text to images presents a significant technical challenge.
Evaluation and Tuning: Developing metrics for evaluating the relevance, quality, and uniqueness of the generated content and tuning models accordingly.
Deployment: Ensuring scalable, user-friendly deployment while maintaining high performance under varying loads.
Monitoring and Feedback: Continuously monitoring performance, incorporating user feedback, and updating models to adapt to new trends and preferences.
How can the tools be improved?
The image generation tools like Midjourney can be improved by allowing me to note the things I did like about the images so it can generate more consistent ones.
The video generation tools like Kaiber and Pika sometimes just generate videos that are deformed, distorted, warped and blurry. I found ways to eliminate these issues however it came at the cost of completely having to re-generate the video. In other words I had to pay again essentially.
For the voice generation using Eleven Labs I found that the options to edit the voices were limited. I think adding options to edit the voices slightly would be great. In several cases I found that a slight change in the setting would cause a massive change. I didn't necessarily like that.
The ChatGPT sometimes goes completely overboard with the wording if I don't prompt it specifically on what to write. The GPT store has several options for using GPTs to help writers.
Reference image generation
Image generation
Image-to-video generation frame by frame
Image-to-video generation
Trailer script generation
Narrator voice generation
Part one
Enlist some applications of 5G and AI in the following sectors:
Healthcare
Samsung Medison’s NerveTrack1 is an ultrasound feature used to identify nerve structures in real time during the application of anesthesia. NerveTrack owes its accuracy and speed to AI models developed through a collaborative process between doctors and AI engineers.
5G technology will make healthcare more connected. Doctors and patients will benefit from wearable devices that notify healthcare providers immediately if a patient shows symptoms, like a defibrillator sending an emergency alert to doctors with the patient's data.
Transportation
Autonomous vehicles operate with technologies like radar and AI to navigate and make decisions without human input. Integrating 5G enhances these vehicles' capabilities by enabling faster data transmission, improving vehicle-to-vehicle communication, and supporting AI's real-time processing needs. This leads to safer, more efficient autonomous driving experiences.
Intelligent Traffic Management: This implementation uses IP cameras to monitor intersections and optimize traffic flow. It operates on an OpenNESS edge node, incorporating all necessary software stacks to support a 5G RAN (Radio Access Network). This setup allows for real-time traffic analysis and management, aiming to reduce congestion and improve urban mobility.
Agriculture
At the Sinkaberg Hansen salmon farm in Gjerdinga, Norway, video analytics is monitoring fish feeding, enhancing operational management. The farm uses a video fish analytics system, along with 5G and edge computing technologies. This enables the use of high-quality video streams to give farmers precise insights into the fish's behavior and feeding, leading to improved feed management. As a result, feed waste is significantly reduced, which decreases pollution and boosts sustainability efforts.
As wearables become cheaper and 5G improves network capabilities, monitoring the health of livestock through IoT devices is likely to increase. This technology can provide farmers with precise health data, allowing them to minimize antibiotic use while ensuring food safety.
Manufacturing - Smart factory applications
Low-latency 4G/5G wireless connections used by smart factory applications to deliver increased robotic control of machines.
Predictive maintenance on machines and devices.
You can start your research from this link:
Intel 5G and Edge: Computing Optimized for Business Value
Part two
Enlist some applications of IoT and AI in the following sectors:
Healthcare
Automated IoT sensors providing real time data about system, environment or equipment irregularities.
Ebenbuild provides doctors and nurses with an assessement of a patient's lung condition, improving quality and outcome of treatment. The company uses a pre-trained artificial intelligence inference model to run computer vision clusters.
Transportation
A freight train company DB Cargo collects a vast amount of data from sensors and system notifications to analyze everything from basic statistics to complex machine learning models. This data analysis aids in streamlining maintenance operations. For data collection, DB Cargo utilizes BoltGATE 20–25, a robust IoT edge gateway by Eurotech.
The CTA is testing a new system at one of its busiest spots to track how full transit services are. They've added new IoT technology that works with their current ticketing systems and video feeds on buses. A machine learning algorithm is being used to help schedule buses more efficiently, all without having to overhaul their existing fleet management setup.
Agriculture
Autonomous tractors using high resolution video cameras to operate equipment with minimal human intervention, more safely and precisely.
Drones and robots to monitor crops and livestock leading to increased productivity. .
Education
Immersive training using AR goggles and video based learning.
The smart board is a digital, interactive board that responds to touch and special pens. It streamlines teaching by allowing real-time interactions.
You can start your research from this link:
Intel 5G and Edge: Computing Optimized for Business Value
Design Phase
Write a proposal to solve a problem using an Ai solution :
Automating Video Editing using Ai
Increase efficiency
Less time editing.
Reduce overall production time.
Lower post production cost using Ai to automate video editing
Less editors needed.
Enhance creativity
New artist can emerge as the barrier to entry is removed.
Improvement in quality.
Who is having this problem?
Film Editors and Production Teams
High quality output expectation
Tight deadlines
Movie Producers and Directors
Responsible for overall project including financial aspect.
Require efficiency at a reduced cost.
Audience/Viewers
Quality affected by cost lowers audience sentiment.
?
What is the problem?
The process of manually editing video is time consuming and labor intensive.
Requires highly skilled editors to achieve professional results.
Creativity is affected by fatigue of the human editor.
Where does the problem happen?
During the design phase in post production.
?
Why should the problem be solved?
Reduced cost
Removes a barrier to entry
Increased efficiency
Can release more content in the same time frame.
Enhance creativity
Artist and editor can be one
Less fatigue for user
Increased scalability
Handle more work
Bigger projects are possible
Steps to provide the solution
Kind of data
Datasets
Image Datasets
Where to get data
Kaggle.com
Github
Create a system to automate video editing and effects
Mission
Use Ai technology to reduce cost during post production process in the movie industry.
More efficient
More effective
Goal
Reduce the time and financial barriers required to complete video editing and VFX.
Reduce editing to time by 40% by automating
Decrease VFX production cost by 30%