Training essentials for custom models

Learn about the essential steps to effectively prepare for training custom models.

To train custom models, gather a diverse and representative data set for better performance and accuracy.

Images

• Use JPG or PNG files.
• Choose at least 10-30 high-quality images that showcase the brand-specific styles and concepts subjects you want to achieve.
• Capture a varied set of images representing the style or subject.
• Ensure that each image file size does not exceed 50 MB.
• Ensure the images have a resolution higher than 1024x1024 pixels with a maximum 16:9 aspect ratio for landscape or 9:16 for portrait. 
• Keep the aspect ratio consistent with the training dataset. If the training set is in portrait, and you generate square images, they will have cutoff issues upon generation. 
• Crop your sample images to focus on the most important visual elements.
• Include images displaying various viewpoints and backgrounds while maintaining a consistent aesthetic.

Captions

• Use captions to enhance detail and train the custom models on concepts you want the model to generate. 
• Keep image captions short and concise. We recommend no more than 15-18 words.
• Vary sentence structure across all your image captions.
  
• Modify auto captions as needed to inform the model of the details of the concept.
• The Firefly base model does not know famous people or places, so captions should include descriptions of these places to improve potential outcomes.
• Ensure captions include key phrases if you are training a specific Subject or Object – give the subject clear detail in the caption for each image.
• Give 2/3 of training data captions using keywords and descriptive details to better train the model outcome.
  • For example, if there is a brand logo in the images, refer to that as “Adobe logo” to help the model identify the concept is identified in a portion of the training data – don't do this in 1/3 of the image captions, this way the model will learn to identify and generate the logo.

Testing your models prior to publishing 

Prompts

• Use shorter, more precise prompts to better honor the subject and style.

Text to image settings panel 

• The Visual intensity slider is set to lowest by default for optimal identity preservation – however, for creative use cases such as Style reference, increasing visual intensity can produce more vibrant results.  
  
• When using Composition references for subjects, opt for images with white backgrounds or sketches depicting the subject in the desired pose. 

More like this

• Custom models overview
  
• Train custom subject models
• Train custom style models
• Preview and test custom models

Join our community to connect, learn, and engage

For inspiration, expert tips, and solutions to common issues, visit Discord or the Adobe Firefly Community forum. Connect with our team and fellow users to exchange ideas, share your creations, stay updated with the latest features and announcements, and provide feedback.