Izhitsa outlasted its own usefulness by a long margin, and the way it finally went is different from the way the other letters went.
Yat, fita and the decimal i were abolished. They were named in the reform documents, argued over in public, defended by people who cared about them, and removed by decree. Izhitsa was not abolished in that sense. By the time the Russian reform arrived its use had contracted to so few words that it was already effectively out of the alphabet, and the reform decrees name the other letters rather than this one. It is generally described as having lapsed rather than as having been removed.
The words that kept it longest were church vocabulary, chief among them the term for the consecrated oil used in anointing, a Greek word in which the letter had always been written and in which it went on being written after it had disappeared from everything else. A letter can survive a long time inside a single word, particularly a word that is used constantly in one setting and almost never outside it.
That pattern is worth naming because it is the general fate of a letter in a living orthography. Letters do not vanish evenly. They retreat into the vocabulary that is most conservative, which is usually religious, legal or onomastic, and they are last seen in the words that people are least willing to respell.
Izhitsa is still set in the church books today, still read, and still carrying the number 400.