carsondial/slinger-single-word

SentenceTransformer based on intfloat/e5-base

This is a sentence-transformers model finetuned from intfloat/e5-base on the train dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: intfloat/e5-base
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 tokens
• Similarity Function: Cosine Similarity
• Training Dataset:
  • train

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Essential Soft-skills & Competencies for Today’s Executives & Employees\nSoft-skills are defined as the personal attributes that enhance and individual’s interaction, job performance and career prospect. Soft-skills are interpersonal and generally applicable.\n- Excellent presentation skill.\n- Emotional intelligence.\n- Social/networking skill,\n- Business writing/business communication skills.\n- Effective communication skill (fluent speaking and good writing).\n- Work/workplace etiquette.\n- Team playing – the ability to work productively and effectively with others. Also, inter-personal skill.\n- Information and communication technology/computer skills.\n- Apt to learning – ability to learn and adapt to a job very fast with minimal supervision and explanation. Being clever and resourceful.\n- Teaching/training/mentoring skills and abilities.\n- Numerical/mathematical skill.\n- Information gathering and acquisition skills. Also, the ability to keep tabs of happenings in your business, corporate, socio-economic and political environment.\n- Anticipation skill – always try to see things/events coming before they actually arrived/happen.\n- Leadership, supervisory and managerial skills.\n- Adaptability to organisational/corporate changes (both role changes and management changes. Also, change management or transition management.\n- Initiative & independent skills/innovation & idea generation skills.\n- Financial resources management skill.\n- Human resources development and management skill.\n- Conflict resolution and conflict management skills.\n- Motivational skill – ability to motivate your team/group/workers. Also, self-motivation and management skills.\n- Flexibility and creativity. Also, creative thinking skill.\n- Risk taking, risk bearing and risk management skills.\n- Financial report/financial statement interpretation and analysing skills.\nNote that, today’s workplace requires that employees, managers and executives to possess these essential soft-skills…\nLike our page: facebook.com/vaxity',
    'Skills',
    'AMP',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

train

• Dataset: train
• Size: 100,000 training samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 51 tokens mean: 386.54 tokens max: 512 tokens	min: 3 tokens mean: 3.46 tokens max: 7 tokens

• Samples:

  anchor	positive
  Adult Beginners in Top QualityNow you can enjoy Adult Beginners in HD format with duration 90 Min and has been launched in 2015-04-24 with MPAA rating is 0. - Original Title : Adult Beginners - Movie title in your country : Adult Beginners - Year of movie : 2015 - Genres of movie : Comedy, - Status of movie : Released - Release date of movie : 2015-04-24 - Companies of movie : Vantage Holdings, Burn Later Productions, Duplass Brothers Productions, - Countries of movie : United States of America, - Language of movie : English, - Durationof movie : 90 Min - Average vote of movie : 0 - Youtube ID of movie : b-qAKSwme5Q - Translation of movie : EN,PT, - Cast of movie : - Nick Kroll ( Jake ) - Rose Byrne ( Justine ) - Bobby Cannavale ( Danny ) - Joel McHale ( Hudson ) - Caitlin Fitzgerald ( Kat ) - Bobby Moynihan ( Paul ) - Josh Charles ( Phil ) - Jane Krakowski ( Miss Jenn ) - Paula Garcés ( Blanca ) - Jason Mantzoukas ( ) See full with title Adult Beginners full and free in high definition format. Play with title Adult Beginners free an fun at here. Right now, you could see that hundreds thousands of people seeking free Adult Beginners movie and enjoy it on the sweat home with net connection. End up being happy, you can certainly reach thousands and thousands of happy members which became sick and tired of waiting intended for dvds inside mail, and now you can enjoy without cost Adult Beginners. You will get new on the web movie, and Obtain it for free in our site. It's fast, easy, free and furthermore to test. Play now Adult Beginners online movie devoid of downloading. You can view video in HD excellent in 90 Min length. Observe trailer movie as well as full film of Adult Beginners go through the button below to enjoy these movie. Movie plot of Adult Beginners : Get full Adult Beginners in Top Video Format with movie synopsis "Out of a job after a disastrous product launch, a big-city yuppie retreats to his suburban childhood home, in this heart-warming and hilarious film about crashing hard, coming home and waking up." in top video format. Full Length of Adult Beginners in Best Quality by clicking the button link. ... Enjoy Full Adult Beginners in HD Video 1080p ... Director : Ross Katz, Screenplay : Jeff Cox, Screenplay : Liz Flahive, Story : Nick Kroll, Cinematography : Vanja Cernjul, Editor : Paul Frank, Yes, now you can view movie regarding Adult Beginners in full length and obtain the connect to this film Adult Beginners in high quality.	Movie
  charter.net Site Stats Copy & Paste code on your website to use the widget. charter.net Social Monitoring Social Media is one of the best way to market your website. Considering Social Media on your marketing strategy will surely boost your traffic. charter.net On Page SEO On Page SEO is a strategy of implementing website content to optimize their position on search engines. Analise the data carefully and use it to optimize your website. Header Tags are used to structure the contents of a document by specifying a hierarchy of sections. They help creating the document outline for visitors and search engines Traffic Graph & Visitors by Country for charter.net This Traffic Graph may help you understand how charter.net performs in terms of traffic and which country is the traffic comming from. NOTE: The information below is not accurate and must be use for research purposes only. Compete traffic analysis for charter.net charter.net Server Location This map will show you where the server of charter.net is located. Sometimes server location is consedered as one of the factors of website loading time. charter.net Response Header This is the response message of charter.net server. This will show you the server configuration and special information about the request. charter.net DNS Record Below is the DNS record of A,NS, MX for charter.net. charter.net. 3040 IN NS auth1.ns.charter.net. charter.net. 3040 IN NS auth0.ns.charter.net. charter.net. 3600 IN MX 10 ib1.charter.net. charter.net Similar Sites List of websites that maybe similar to charter.net accourding to their keywords. This is the whois information of charter.net. This data contains information about the owner and registrant of the domain. Get Your Facebook Like-Box Widget To use the widget, Copy the code below and paste it to your website and replace the red text with your facebook page url. var site_stats_fb_url = "http://www.facebook.com/pages/Site-Stats-Info/183188521756448"; Get Your Twitter Widget To use the widget, Copy the code below and paste it to your website and replace the red text with your Twitter Username. var site_stats_tweet = "sitestatsinfo"; Note : You need to have jQuery library included on your website. If you dont have jQuery yet, copy the code below and paste it on the top of the other code. Widget example is on the right side of this page.	Website
  Cheques can still be unpaid by the bank, at a later date. The time this takes will depend on the country involved — it can take several weeks. Moving abroad Moving abroad. Find out more Premier Banking. The Jersey, Guernsey and Isle of Man branches of Lloyds Bank Corporate Markets plc are each separately licensed as regulated deposit-takers in their respective jurisdictions. For more information on ring-fencing visit international. Both companies are part of Lloyds Banking Group plc. See Company Information. Whilst our services will be available to many customers, there are countries where, due to legal or regulatory restraints, we cannot provide them. Rules and regulations made under the UK Financial Services and Markets Act for the protection of depositors and investors, including the Financial Services Compensation Scheme, do not apply to the financial services business of companies within the Lloyds Banking Group carried out from offices outside of the United Kingdom. Lloyds Bank Corporate Markets plc. Registered in England and Wales no. Authorisation can be checked on the Financial Services Register. Services provided by the Jersey, Guernsey and Isle of Man branches of Lloyds Bank Corporate Markets plc will be subject to the regulatory regime applicable in their respective jurisdiction, which will differ in some or all respects from that of the UK. Further information about the regulatory status of the Jersey, Guernsey and Isle of Man branches of Lloyds Bank Corporate Markets plc, is set out below. Lloyds Banking Group plc does not guarantee the liabilities of its subsidiaries. Rules and regulations made under the UK Financial Services and Markets Act , including the Financial Services Compensation Scheme, do not apply to the financial services business of companies within the Lloyds Banking Group carried out from offices outside the United Kingdom. Copies of our terms and conditions and latest report and accounts are available upon request from the above registered office. Copies of our terms and conditions are available on request from the above registered office. Eligible deposits are deposits held by private individuals and charities. Depositor protection does not extend to corporations, small to medium sized enterprises, partnerships and trusts. Full details of the Scheme and banking groups covered are available on the States of Jersey website or on request. Deposits with the Guernsey branch of Lloyds Bank Corporate Markets plc will not be covered by any equivalent deposit compensation scheme to the Guernsey Banking Deposit Compensation Scheme in any other jurisdiction. Lloyds Bank International Services Limited. Please note that, in relation to banking services which we provide, you might not be eligible for compensation under a deposit protection guarantee scheme available in your country of residence. If in doubt, contact your local banking regulator, visit their website or seek independent advice. Depositors may wish to form their own view on the financial standing of Lloyds Bank Corporate Markets plc and Lloyds Bank International Services Limited and their respective parent company based upon publicly available information. Legislation or regulations in your home jurisdiction may prohibit you from entering into such a transaction with us. We reserve the right to make final determination on whether you are eligible for any products or services. Residents or Nationals of certain jurisdictions may be subject to exchange controls and should seek independent advice before entering into any transactions with us. Correspondent and recipient bank charges may apply. Find out how the process works. Check you're eligible by answering a few questions. This service could be particularly useful for people: Topping up a bank account in a different country. Paying bills. Sending money to family. Making purchases. Running a home or a holiday home. Working or living abroad. About to move to the UK. Buying or investing in a property abroad. Travelling frequently. With dependants in different countries. Assess your needs If you know you will need to send money abroad on a regular basis, it could make sense to set up an international bank account. Think about how you want to make payments Lloyds Bank Corporate Markets plc lets you make payments online 24 hours a day, 7 days a week, or over the phone. Understand the various methods available for sending money overseas and weigh up the pros and cons. There are several options to choose from: Electronic transfers The cheapest and simplest way of sending money abroad is through an electronic transfer. International Standing Orders These allow you to make overseas money transfers on a regular basis using your International Currency Account. Check the exchange rate. Decide on the currency you want to use. You can make a payment in two ways Pay in your own currency, which is then converted into the local currency when it arrives at its destination Convert the amount into the destination currency before paying it overseas When you make overseas money transfers online with your international currency account, you'll be able to see clearly how much money will leave your account — or how much the recipient will get. Gather the information you need from the intended recipient. Set up the payment details. Pay all Charges: A Correspondent Bank Fee will be payable for international payments where you choose to pay the charges for the recipient, if you are permitted to do so based upon the destination of the payment and the type of account that you hold. The Correspondent Bank Fee replaces all Correspondent bank charges. The recipient bank may still charge its customer a fee but we cannot provide information about such a fee. The amount of the Correspondent Bank Fee depends on the location of the recipient bank. Cheques in a foreign currency drawn in a different country e. We offer a wide range of foreign exchange services. When you make a payment online, you'll be told how much you should expect to leave your account or how much the recipient will receive. If you want certainty over the exchange rate, you should make your payment in the currency of the country you are sending it to. Otherwise, you won't know what exchange rate is going to be used by the receiving bank. Payments are processed using our standard exchange rate. The tables below provides an indication of the margin, which is the current percentage difference between this rate and the rate at which we buy and sell currency in the foreign exchange markets the wholesale rate. The margin will be applied and incorporated within your foreign exchange rate. Please note if you are sending funds from a Sterling International account please refer to below table:. Please note if you are sending funds from a Currency International account please refer to below table:. For our exchange rates for international money transfers , please call us or contact your Relationship Manager. However, correspondent and recipient bank charges may apply. There may be limits on payments you can make and we may not be able to start processing all payments instructed out of normal banking hours. We may make additional security checks before acting on a particular request for an International Money Transfer, when we believe we are justified in doing so. You'll need to provide us with your recipient's bank account number and the full name and address of their bank. You'll need to give us accurate information about the person you are sending it to. This includes:. You'll need to get these details from the person you want to transfer money overseas to. It is a unique code that identifies an individual bank account. Please note that IBANs can have a different number of characters and are a mix of letters and numbers. Your payment should get to the recipient's bank in days — the time it takes will vary from country to country. We aren't in control of how long it takes the recipient's bank to process the transfer, however. You'll get a reference number if you pay online and can print off your own receipt. Payments made by phone will be shown on your statement, so please check this carefully. Payment confirmations are available upon request. If for any reason the money doesn't arrive, please tell us as soon as possible and we'll try to trace it. You may be charged for this service. Charges will vary depending on the value of the cheque and whether it's paid into a Currency Account or a Sterling Account. Cheques or drafts by negotiation will be credited to your account in a few days, minus charges. This service can only be used if the draft or the cheque is in the local currency. Credits from cheques can still be reversed by the bank at a later date if it turns out that the payer's bank account has insufficient funds. If the payment is from a high-risk country or isn't in the sender's local currency, it's likely the payment will be sent for collection. This means your account won't be credited until we're certain the money will be paid. The time this takes will depend on the country involved — it can take several weeks. You can make international money transfers online via Currency Internet Banking. This service is for any of these international accounts:. View demo. Available online 24 hours a day, 7 days a week. We won't charge you for transferring money overseas. Use our online calculator for an indication of cost and fees for the payment. Make a payment. You can use our international payments calculator to get an estimate of how much a payment will cost. If you make the payment using Internet Banking then the recipient will pay their bank or correspondent bank charges that may apply. Payments made before 3pm on a working day will be processed the same day. Otherwise, the payment will be processed on the following working day. Mon-Fri 8am-6pm and Sat. Check eligibility Is international banking for you? Find out more International Current Accounts. Find out more Guide to sending money abroad. The Jersey, Guernsey and Isle of Man branches of Lloyds Bank Corporate Markets plc are each separately licensed as regulated deposit-takers in their respective jurisdictions. For more information on ring-fencing visit international. Both companies are part of Lloyds Banking Group plc. See Company Information. Whilst our services will be available to many customers, there are countries where, due to legal or regulatory restraints, we cannot provide them. Rules and regulations made under the UK Financial Services and Markets Act for the protection of depositors and investors, including the Financial Services Compensation Scheme, do not apply to the financial services business of companies within the Lloyds Banking Group carried out from offices outside of the United Kingdom. Steps for remote connections. I am high sierra and was wondering if. - it Ford Aspire with one. Contacts, but help you Client will but Bit-Defender, software, and extensive documentation. Debit cards for each of the accounts can be used without a fee, so long as the correct card is used for the correct currency. International withdrawals from cash machines will also not be charged by SPBJ. Offshore bank accounts are most often funded electronically through international wire transfers. Unfortunately, the systems that enable free electronic transfers common in domestic banking are typically not able to transfer money internationally. Sending a wire transfer is a simple operation, but almost all banks charge international wire transfer fees to send or receive funds. Pricing for wire transfers varies from bank to bank, so if you use this service a lot be sure to look for deals like the Citibank one. Fund transfers are free. You can also get fee free foreign currency cheque deposits and accounts. You also get a dedicated relationship manager, personal concierge service and worldwide holiday travel insurance for the whole family - including winter sports. Citibank charges exchange rates when you transfer between currencies. If you move to the UAE, you will need to open a local bank account to pay in your salary — a requirement when you live and work in the region. But many expats also open an offshore account to help with ease of banking in other currencies. Barclays International Banking is one good option - most of its UAE resident accountholders are expats who have moved to the UAE for work and need to continue their financial links with the UK — for example mortgage commitments on a UK property or children in UK education. Barclays International Banking of fers two services. There is also a relationship manager service, which has no fee. Both come with accounts that are available in a choice of sterling, US dollars or Euros and you are given a debit card sterling accounts only or a Barclays deferred debit card US dollar and euro accounts. For UAE-based expats, having an offshore US dollar account alongside sterling accounts can be a useful tool in managing foreign exchange exposures as the local currency — the Dirham - is pegged to the US dollar — so expats are essentially earning in dollars and possibly saving or spending in the UK in sterling. If you use your debit card abroad or pay in a currency other than sterling you will be charged a 2. This fee will also apply whenever you do not pay in sterling, for example when you shop online at a non-UK website. The receiving bank may also apply a charge. With the offshore account you can have a choice of location for your account — London or in the Isle of Man. Depending on where you live, you can choose which will provide the most efficient tax options for you. If you are thinking about opening a Barclays offshore account it is also worth setting up a Barclays onshore account in the UAE for your salary and general transactions. Competition among local banks is fierce — and as such most local accounts in the UAE, and Dubai in particular, offer free cash withdrawals and fee-free transactions — as well as a variety of other perks. The benefit of opening a local account with Barclays, however, as opposed to another bank, is that if you use online banking to make a transfer to Barclays International Banking there are no charges. If you transfers via a branch or fax then you get one free transfer to a Barclays international account a month. Offshore accounts are not for everyone. Minimum balance requirements can reach seriously heady heights - and fees add up pretty quickly too. But, because it can be tricky for non-UK residents to open a bank account in the UK without a local address or actually visiting a branch in person, many people think going offshore is their only option. However, if you need a simple current account in the UK for family members, bills or your eventual return, the following providers could help. Bank of India offe rs a service to non-UK residents who wish to open an account. This account is really only useful if you want to deposit money into a UK account - there is no online banking or debit card, so your money is difficult to access from abroad. Th is allows for payments using internet banking and provides a debit card. Non-UK resident account holders can receive interest on their account without a UK tax deduction by completing the R form which can be downloade d here. You can apply by post - all you need to do is send at least two certified copies of identification documents and fill out an application. Normally this service is provided to HSBC account holders planning a move to another country where HSBC has a retail presence - you would not, for example, be able to open an account in Italy. Once opened, the account would be fully functional so you can start paying in before your move. Your credit history is also transferred. If you need to have a foreign account for an indefinite period without actually relocating you would have to arrange it on an individual basis with the bank - HSBC has assured This is Money that it is an option. This service is only available to HSBC customers, but you could open an account with the bank in your home country and then ask for a transfer. Some links in this article may be affiliate links. If you click on them we may earn a small commission. That helps us fund This Is Money, and keep it free to use. We do not write articles to promote products. We do not allow any commercial relationship to affect our editorial independence. The views expressed in the contents above are those of our users and do not necessarily reflect the views of MailOnline. How we can help Contact us. Here are your options in the current market turmoil I'd rather check shares than chuck TVs out of windows' Want to top up your state pension, but baffled over which years to buy? Moving to sunnier climes or overseas for work? Bad rep: offshore accounts sound like something from a James Bond film. Choosing the best offshore account for you Offshore current accounts vary quite dramatically so it will pay to scout around and find the best one before beginning your new adventure. Can you save money on international transfers? Get a free guide to buying property overseas. Good choice: which offshore account to go for for expats in UAE. Current Accounts Of The Week. Share or comment on this article: Five of the best offshore current accounts e-mail Toggle Search. Leading business recovery group warns that number of Queen's favourite chocolate brand Rococo changes hands in Inspiring Learning, which provides educational adventure NatWest customers being warned to be on their guard As iconic brand has record year, boss Kenny Wilson says City traders betting on squeeze at supermarket giant Asda As probe into sale of tech firm steps up, family behind City investors betting on fall in price of British Ditch corporation tax hike, bosses tell PM Boris Johnson Charities may seem an unlikely source of inspiration for Greenland IS Comments 36 Share what you think. View all. More top stories. Best buy savings tables. DON'T MISS Dealers put the brakes on electric car orders: Drivers wanting to make the switch could have to wait more than a year to buy one as availability runs dry Waiting times for Tesla's Model S and Model X are now up to two years I'm a small car dealer and pay for my own stock - should I borrow from the bank to grow my business? Not only have these exotic assets excited the retail trading segment of the market to the point where regulation of exchanges that offer cryptos is no longer seen as a barrier for entry, but the existence of several unregulated but very strong and robust exchanges like Binance and Huobi seem to have spoken a message to retail traders: regulation of a brokerage may not really matter if the expectations of traders are being met. Binance and several other crypto exchanges which are still standing and delivering value to their clients are unregulated, yet customers have never complained of being shortchanged or not receiving their profits when they are withdrawn. This seems to have given many retail traders confidence to place their money with offshore forex brokers who are generally regarded as being weak on regulation. Some of the brokers showcased on our list have also gone ahead to show by their business conduct that they can be relied on to deliver transparency and a sound trading experience, whether they are regulated or not. The list on this page features several offshore forex brokers that are located across the Level D and Level E jurisdictions. One factor that they all have in common is that they tend to offer to their clients, what they cannot get elsewhere. For instance, the high leverages that they provide are virtually non-existent in the EU and UK. So if you are excited by some of these offerings and can take the risk of doing business with brokers that are softer on regulation, feel free to make a selection from the list above. Location New Zealand. Saint Vincent and the Grenadines. Saint Kitts and Nevis. British Virgin Islands. Cayman Islands. Marshall Islands. Platforms Web. MetaTrader 4. MetaTrader 5. Social Platform. Binary Platform. Instruments Currencies. Funding methods Wire Transfer. Credit Cards. Perfect Money. Yandex Money. Moneta Ru. Loading more results. Hallmarks of Offshore Forex Brokerage Business Despite the unregulated nature of Level 5 jurisdictions, offshore forex brokers in these areas are still seeing good patronage from across the world. Show Results.	banking

• Loss: GISTEmbedLoss with these parameters:

  {'guide': SentenceTransformer(
    (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel 
    (1): Pooling({'word_embedding_dimension': 384, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
    (2): Normalize()
  ), 'temperature': 0.01}
  

Training Hyperparameters

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: no
• prediction_loss_only: True
• per_device_train_batch_size: 8
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 3.0
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• eval_use_gather_object: False
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss
0.04	500	0.2671
0.08	1000	0.2567
0.12	1500	0.28
0.16	2000	0.2596
0.2	2500	0.2581
0.24	3000	0.2334
0.28	3500	0.2443
0.32	4000	0.2331
0.36	4500	0.2355
0.4	5000	0.2322
0.44	5500	0.2342
0.48	6000	0.2336
0.52	6500	0.2004
0.56	7000	0.1871
0.6	7500	0.2108
0.64	8000	0.2046
0.68	8500	0.2158
0.72	9000	0.2125
0.76	9500	0.2124
0.8	10000	0.2448
0.84	10500	0.2037
0.88	11000	0.1873
0.92	11500	0.2022
0.96	12000	0.2096
1.0	12500	0.2223
1.04	13000	0.1314
1.08	13500	0.1188
1.12	14000	0.1494
1.16	14500	0.1312
1.2	15000	0.1311
1.24	15500	0.1261
1.28	16000	0.1144
1.32	16500	0.1153
1.3600	17000	0.1189
1.4	17500	0.1067
1.44	18000	0.1236
1.48	18500	0.1163
1.52	19000	0.0926
1.56	19500	0.0946
1.6	20000	0.0987
1.6400	20500	0.1074
1.6800	21000	0.1075
1.72	21500	0.0897
1.76	22000	0.0988
1.8	22500	0.0997
1.8400	23000	0.0872
1.88	23500	0.0885
1.92	24000	0.0973
1.96	24500	0.1003
2.0	25000	0.0875
2.04	25500	0.0754
2.08	26000	0.0716
2.12	26500	0.0771
2.16	27000	0.0733
2.2	27500	0.0748
2.24	28000	0.0834
2.2800	28500	0.0792
2.32	29000	0.0662
2.36	29500	0.08
2.4	30000	0.0572
2.44	30500	0.0723
2.48	31000	0.0641
2.52	31500	0.0555
2.56	32000	0.0641
2.6	32500	0.0597
2.64	33000	0.061
2.68	33500	0.0647
2.7200	34000	0.0537
2.76	34500	0.0614
2.8	35000	0.0595
2.84	35500	0.0528
2.88	36000	0.0623
2.92	36500	0.0595
2.96	37000	0.0598
3.0	37500	0.0626

Framework Versions

• Python: 3.10.4
• Sentence Transformers: 3.0.1
• Transformers: 4.44.0
• PyTorch: 2.4.0+cu121
• Accelerate: 0.34.2
• Datasets: 2.21.0
• Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

GISTEmbedLoss

@misc{solatorio2024gistembed,
    title={GISTEmbed: Guided In-sample Selection of Training Negatives for Text Embedding Fine-tuning}, 
    author={Aivin V. Solatorio},
    year={2024},
    eprint={2402.16829},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}