About the alignernet training data form

[srymaker]

Thank you for your great work！
I wanna know about the align training stage’s data form. Specifically, the data format loaded by laion2b_loader in the code and how to build it.

[xichenpan]

Hi I should be like

Kosmos-G/scripts/convert_instructpix2pix.py

Lines 80 to 96 in f5c0489

	json_content = [
	{
	"source": [],
	"source_lang": "instructpix2pix",
	"weight": 1.0,
	"name": "instructpix2pix",
	}
	]
	# find all tsv files in the output directory, save name to json file
	for file in os.listdir(os.path.join(args.output_dir, 'data')):
	if file.endswith('.tsv'):
	json_content[0]['source'].append(file)
	# save json file
	with open(os.path.join(args.output_dir, 'json', 'train.json'), 'w', encoding='utf-8') as f:
	json.dump(json_content, f, indent=4)